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Abstract 

' Achievable rate regions and outer bounds are derived for three-user interference channels where the transmitters 

(N : 

^ , cooperate in a unidirectional manner via a noncausal message-sharing mechanism. The three-user channel facilitates 

D . different ways of message-sharing between the primary and secondary (or cognitive) transmitters. Three natural 



(N 

' sharing; (ii) primary-only message sharing; and (iii) cognitive-only message sharing. To emphasize the notion of 



extensions of unidirectional message-sharing from two users to three users are introduced: (i) Cumulative message 



interference management, channels are classified based on different rate-splitting strategies at the transmitters. 
Standard techniques, superposition coding and Gel'fand-Pinsker's binning principle, are employed to derive an 
Q ■ achievable rate region for each of the cognitive interference channels. Simulation results for the Gaussian channel 

case are presented; they enable visual comparison of the achievable rate regions for different message-sharing 
^ ^ schemes along with the outer bounds. These results also provide useful insights into the effect of rate-splitting at 



the transmitters, which aids in better interference management at the receivers. 



CN '. I. Introduction 

O 

Cognitive radios (CRs) ^ try to improve spectral efficiency by gathering and using knowledge of their Radio 
J> Frequency (RF) environment to adjust their transmission and reception parameters. An overview of the potential 
^ : benefits offered by the CRs in physical layer research is provided in |2]. In |3], three main CR paradigms have 
been identified - underlay, overlay and interweave. In the underlay paradigm, CR users are allowed to operate only 
if their interference to noncognitive (or primary) users is below a certain threshold. While operating in the overlay 
paradigm, the CRs transmit their data simultaneously with the primary users but employ sophisticated techniques 
that maintain (or even improve) the performance of primary users. In the interweave paradigm, the CRs sense 
unused frequency bands called spectrum holes to communicate without disrupting primary transmissions. Of these, 
the information theoretic research has focused primarily on the overlay paradigm where CR transmitters cooperate 
using unidirectional message sharing in a noncausal manner Here, the cognitive user gains access to messages 
and the corresponding codewords of the primary user before transmission. Although clairvoyant, such models are 
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popular in establishing perfomance limits of cooperative multiuser channels. Then, the primary and cognitive 
users simultaneously transmit their messages, but the encoding is performed in such a way that the primary user's 
achievable rates do not suffer. We present first a short survey of recent information theoretic work in this area, 
followed by a summary of our contributions. 

Related work: Besides identifying the three CR network paradigms mentioned above, [3| explored some of the 
fundamental capacity limits and associated transmission strategies for CR wireless networks. In Devroye et 

al defined the two-user genie-aided CR channel and derived an achievable rate region by employing rate-splitting at 
both transmitters. The coding scheme comprised a combination of the scheme proposed by Han and Kobayashi for 
the interference channel ||6], and one proposed by Gel' f and and Pinsker (GP) for coding over channels with random 
parameters Q. In ||8], Wu et al introduced terms like dumb and smart antennas to refer to primary and cognitive 
senders, respectively. They employed a combination of GP and superposition coding (91 techniques, without resorting 
to rate-splitting, to come up with an achievable rate region for the two-user CR channel. In |[TOl . an achievable 
rate region for the two-user interference channel with degraded message sets was derived using a combination of 
superposition and GP coding techniques, where only the CR transmitter employs rate-splitting. In lOTI . Jovicic et 
al presented the Gaussian CR channel and derived capacity bounds/results for low and high interference regimes 
by employing dirty paper coding 11121 . and joint code design at the two transmitters and multiuser decoding at the 
primary receiver. 

Other prominent information theoretic results in the area of CR networks are as follows. Capacity bounds for 
two-user interference channels with cognitive and partially cognitive transmitters were reported in ||T3l - lITSl . In 
|[T9l - |[23l . information theoretic results for interference channels with common information were derived. The 
sum-capacity of the Gaussian MIMO cognitive radio network was presented in [24], where the results applied 
to the single-antenna CR channel as well. Capacity scaling laws for CR networks were presented in ||25l, while 
ll26l considered achievable rates when the encoder non-causally knows different channel states. Multiple access 
channels with cooperation have been considered in ||27l - ||29l . Furthermore, the algebraic structure of random 
binning schemes of |7| and |[T2|| have been studied in ||30l - |[33l . paving the way for practical realization of 
channel codes for CR networks. 

Our contribution: With increasing interest in CR technology, one is motivated to consider a network of CRs 
sharing the same channel with an incumbent primary user. In particular, how do the primary user and the network 
of CRs cooperate assuming the overlay network paradigm? In this paper, we consider the case of three-user CR 
interference channels, where two (or one) CRs and one (or two) primary user communicate with three respective 
receivers. We consider three message sharing mechanisms between the senders, which are extensions of the two- 
user unidirectional message sharing paradigm to the three- user case. We term these three approaches (i) cumulative 
message sharing (CuMS); (ii) primary-only message sharing (PrMS); and (iii) cognitive-only message sharing 
(CoMS). To deal with interference in this three-user channel, we use rate-splitting, which was first reported in 
in, to enlarge the achievable rate region for the classical two-user interference channel. The main idea behind 
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rate-splitting is to encode part of the message at a possibly low rate, so that the unintended receiver can decode 
the interference caused to it by performing simultaneous decoding. To this end, we define five cognitive channel 
models, two each for CuMS and PrMS, and one for CoMS, with different rate-splitting strategies. The types of 
message-sharing mechanisms and rate-splitting strategies will be made precise in the next section. We then employ 
the standard technique of combining GP's binning principle |7 | and superposition coding [9| to derive an achievable 
rate region for each of the five channels. As a result, we illustrate the generality of the techniques employed here, 
and provide useful insights into the rate regions and their characterization. Next, we specialize the achievable rate 
regions to the Gaussian channel; this enables comparisons of the different rate regions both analytically and through 
simulations. We also present simple corollaries that help enlarge the rate regions in the Gaussian case. Finally, we 
compare our achievable regions to some outer bounds, and thereby provide some insight into the optimality of the 
proposed coding scheme. Initial results of this work have appeared in ll34l - ll36l . 

The outline of the paper is as follows. In Section II, we introduce the discrete memoryless channel models for 
CuMS, PrMS and CoMS, and review the notation used in the paper. We also present the probability distribution 
functions characterizing these channels. In Section III, we present the achievability theorem for the channel models 
and work out the details of the proof for one of the channel models. In Section IV, we consider the Gaussian 
channel model and construct the framework for numerical evaluation. We also state corollaries that enlarge the 
rate regions in the Gaussian case and derive some outer bounds. Simulation results and related discussions are 
presented in Section V. We conclude the paper in Section VI. The achievable rate region equations for the five 
discrete memoryless channels considered in this paper, the proof of the achievabihty theorem for one channel model 
and proofs of corollaries are relegated to the Appendix. 

II. Discrete Memoryless Channel Model and Preliminaries 

The three-user discrete memoryless cognitive interference channel is described by (Afi, Af2, Afa, "P, 3^2, 3^3)- 
For k = 1,2,3, 

1) the senders and receivers are denoted by Sk and TZ^, respectively; 

2) finite sets and denote the channel input and output alphabets, respectively; 

3) random variables Xk G and G yk are the inputs and outputs of the channel respectively; and 

4) V denotes the finite set of conditional probabilities p (yi, y2,y3\xi,X2,X3), when (xi, 2:2, X3) ^ XiX X2X 
are transmitted and (2/1,2/2,2/3) G J'l x 3^2 x 3^3 are obtained by the receivers. 

The channels are assumed to be memoryless. In the classical three-user interference channel, the messages at the 
senders are given by G A4k = {!,••• ,Mk}; M.k being a finite set with elements. The messages are 
assumed to be independently generated. 

A. Message-Sharing Mechanisms 

We describe now the message-sharing mechanisms considered in this paper. 
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1) In the case of cumulative message-sharing (CuMS), sender ^2 has noncausal knowledge of the message mi 
and the corresponding codewords of the primary sender, Si. Sender has noncausal knowledge of the 
message mi of the primary transmitter as well as the message m2 of 52, and their respective codewords. A 
schematic of CuMS is shown in Fig. 1. 

2) In the case of primary-only message-sharing (PrMS), senders ^2 and have noncausal knowledge of the 
message mi and the corresponding codewords of the primary sender, Si. There is no message-sharing 
mechanism between ^2 and S-^ themselves. See Fig. 2 for a channel schematic. 

3) In the case of cognitive-only message-sharing (CoMS), sender ^3 has noncausal knowledge of messages mi 
and m2, and the corresponding codewords of senders. Si and ^2. There is no message-sharing mechanism 
between the Si and ^2. A channel schematic for CoMS is shown in Fig. 3. 

An ^Mi, M2, M3, n, Pi"'*^ code exists for these channels, if there exists the following encoding functions: 

/i : A^i ^ AT, /{ : Mi^ , /f : Mi ^ 
/2 : A^i X A^2 ^ X^, /a : Mi x M2 ^ fi ■ -^2 ^ ^2 
/a : A^i X A^2 X A^3 ^ X^, f'^: MixM^^ X^, /s : TWi x 7W2 x TWg ^ X^ 

and the following decoding functions, for k = 1,2,3: 

9k ■■ ^ Mk, g'k : ^ Mk, gl : yi ^ Mk, 

such that the decoding error probability max | Pg"-* , pj:^2 ) 3^ | is < Pi"'' . Pg'^'' is the average probability of 
decoding error computed using: 

Pe'[k = M M M ^ P ["ifc / (mi, m2, ms) sent] ; A; = 1, 2, 3. 

mi ,m2,m3 

fk (or gk) correspond to the encoders (or decoders) used by channels with CuMS, (or g'j^) correspond to the 
encoders (or decoders) used by channels with PrMS and (or g'j^) correspond to the encoders (or decoders) used 
by channels with CoMS. 

We define two channels denoted Cq^^^ , two channels denoted Cp^j^g and one channel denoted Ccoms; t = 1,2. 
A non-negative rate triple (Pi, P21 P3) is achievable for each of the channels, if for any < Pi"^ < 1 there exists 
a (^2^"^!! , 2^"^=^! , 2^"^^! , n, Pi"^^ code such that p]"'' as n 00. The capacity region for the channels is the 
closure of the set of all achievable rate triples {Ri, R2t R3). A subset of the capacity region gives an achievable 
rate region. 



B. Rate-Splitting Strategies 

In 161, it has been shown that achievable rate region for the classical two-user interference channel can be enlarged 
by rate-splitting. Specifically, each transmitter encodes part of the message at a possibly low rate and constructs 
its codewords using superposition coding. This results in the unintended or non-pairing receiver being able to 
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decode and cancel out the low rateLj sub-message from the interfering transmitter using simultaneous decoding, 
thereby enlarging the achievable rate region. This forms the motivation for employing rate-splitting, as an effective 
interference management mechanism. In the three-user scenario, however, many more rate-splitting strategies exist 
compared to the two-user case. For example, sender Si can perform rate-splitting in one of the following four 
ways: (i) it can encode a part of its message such that both unintended receivers, 7^2 and TZ^, can decode the 
sub-message; (ii) encode a part of the message such that Tl2 can decode it but not TZ^; (iii) encode a part of the 
message such that TZ^ can decode it but not 7^2; and finally, (iv) encode in a manner such that the sub-message 
is not decodable at either 7^2 or TZ^ (i.e., decodable only at the TZi). In this paper, we consider the following 
rate-splitting strategies: 

1) In CpuMS ^PrMS' senders encode part of their respective messages at a rate such that it can be reliably 
decoded by all the receivers. The other part of the message will be encoded at a rate such that only the 
intended or pairing receiver can decode it. 

2) In C^^f^s and Cp^j^g, one part of the message is encoded such that only the intended receiver can decode it, 
while the other part is encoded at a rate such that it can only be decoded at the intended reciever and the 
receiver Ki. 

3) In CcoMS> sender ^3 encodes one part of the message at a rate such that all receivers can decode it, while 
the other part is encoded at a rate such that it can only be decoded at its pairing receiver, TZ^- There is no 
rate-splitting at Si and 52- 

Note that, regardless of the manner in which rate-splitting is performed, TZt should always be able to reliably decode 
the codewords from St, t = 1,2,3. 

The notation for describing the achievable rates of these sub-messages and their respective description is tabulated 
in Table Jl The decoding capabilities of receivers, resulting from rate-splitting at the transmitters, are summarized 
in Tables HIl |lll] and [IVl We also introduce auxiliary random variables defined on finite sets and tabulate them in 
Table |Vl Depending on the rate-splitting strategy employed by the senders, only a subset of these sub-messages, 
their corresponding rates, and the corresponding auxiliary random variables will be used to derive an achievable 
rate region for each channel model. Note that we do not consider the practical aspects of the underlying physical 
realization of such models. Also, the capacity region for a general CR channel still remains an open problem. 

C. Channel Modification 

Rate-splitting necessitates modification of the channels C^^jyjg, Cp^j^^ and Ccoms;* = li2. Here, we explicitly 
show the modification for one channel (C^uMs)' ^^'^ modification for the other channel models is similar. Referring 
to the rate-splitting strategy for the channel C^^j^g, the messages at the three senders in the modified channel can 
be written as: 

'in the literature, this is typically called the "public part" of the message. Its rate could be large if the cross-channel gains are large. 
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Sender 1: mn G Mu = {1, . . . , Mn}, 
Sender 2: 11121 G M21 = {1, . . . , M21}, m22 G M22 = {1, • • • , M22}, 
Sender 3: msi G TWsi = {1, • • • , M-n}, mga G 7W33 = {!,•••, M33}, 

with all messages being defined on sets with finite number of elements. Note that, there is no rate-splitting at sender 
Si, but for consistency in notation we write nii as mn. 

We define an ^A/n, Af2i, M22, M31, M33, n, Pi"^^ code for the modified channel as a set of Mn codewords 
for Si, M11M21M22 codewords for ^2, and M11M21M22M31M33 codewords for ^3, such that the average prob- 
ability of decoding error is less than Pe"'\ We call a tuple (-Rn, -R2i5 ^22, ^31, ^33) achievable if there exists a 
sequence of (2^^Rll^ ^2^"R2i] ^2^nR22] ^2^nR,^^ ^2^nR,,] p(n)\^ ^^jg^ ^^^^,^1 that p]"^ ^ as n ^ 00. Here, Ru 

corresponds to Ri. The capacity region for the modified channel is the closure of the set of all achievable rate 
tuples i?2i5 ^22, ^31, ^33)- It can be shown that if the rate tuple {Ru, R21, R22, R31, R33) is achievable for 
the modified channel, then the rate triple {Rii,R2i + R22,Rsi + R33) is achievable for the channel Cq^^^ (see |l6j 
Corollary 2.1]). In a similar fashion, the remaining channel models can be appropriately modified; the details are 
omitted to avoid repetition. 

D. Probability Distributions 

Here, we present the probability distribution functions which characterize the channels C^^^s^ C^^^^, Cp^^S' ^PrMS 
and CcoMS- Let Pcums denote the set of all joint probabiUty distributions Pcums(-); t = 1,2 respectively, that factor 
as follows: 

PCuMs(9' Wo,Wi,Xi,Uo, U2, X2, Vq, V3,X3,yi,y2, y3) = 

p{q)p{wo,wi,xi\q)p{uo\wo,wi,q)p{u2\wo,wi,q)p{x2\uo,U2,wo,wi,q)p{vo\uo,U2,Wo,wi,q) 

P{V3\U0, U2,Wo, Wi,q)p{x3\vo, V3,Uo, U2,Wq,Wi, q)p{yi,y2,y3\xi, X2, X3) , (1) 

PCuMs(9, W, Xi,Ui,U2,X2,Vi,V3,X3,yi,y2, y3) = 
p{q)p{w, xi\q)p{ui\w, q)p{u2\w, q)p{x2\ui,U2,w, q)p{vi\ui,U2,w, q)p{v3\ui,U2,w, q) 

P{x3\vi,V3,Ui,U2,W,q)p{yi,y2,y3\xi,X2,X3). (2) 

Let "Ppi-Ms denote the set of all joint probability distributions PprMs(-); t = 1,2 respectively, that factor as follows: 

PPrMs(9, Wo,Wi,Xi,Uo,U2,X2,Vo,V3,X3,yi,y2,y3) = 

p{q)p{wQ, wi,xi\q)p{uQ\wo,wi,q)p{u2\wo, wi,q) 
p{x2\uQ,U2,WQ,wi,q)p{vQ\wQ,wi,q)p{v3\wo,wi,q)p{x3\vQ,V3,WQ,wi,q)p{yi,y2,y3\xi,X2,X3), (3) 

plms{(l^w,xi,ui,U2,X2,vi,V3,X3,yi,y2,y3) = 
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p{q)p{w, xi\q)p{ui\w, q)p{u2\w, q) 
p{x2\ui,U2,w, q)p{vi \w, q)p{v3\w, q)p{x3\vi,V3,w, y2, ya^i, X2, X3). (4) 

Let T^coMS denote the set of all joint probability distributions pcoMs(-) respectively, that factor as follows: 

PcoMS {q,wi,xi,U2,X2,vo,V3,X3,yi,y2,y3) = piq)p(wi,xi\q)p{u2,X2\ q)p{vo \wi,U2,q)p(v3\wi,U2,q) 

P{x3\vo,V3,U2,Wi,q)p{yi,y2,y3\xi,X2,X3). (5) 

The lower case letters {q,w,U2,V3, etc.) are reaUzations of their corresponding random variables, and note that 
for notational simplicity, the same letter (p) is used to denote all the different probability distributions above. An 
achievable rate region for each channel is defined by a set of non-negative real numbers (referred to as rate tuples) 
that satisfy certain information-theoretic inequalities. An achievable rate region for each of the channels considered 
in this paper are given in Appendices A, B and C. 

III. ACHIEVABILITY THEOREM AND PROOF 

Theorem 3.1: Let ^cuMs(°'" ^PrMS '^^ ^Coms) denote the capacity region of the channel C^ums(°'' ^PrMS '^^ Ccoms); t = 
1,2. Let 

^CuMS = U ^CuMs(PcuMs)i^PrMS = U ^PrMs(PprMs) ^^1^ O^CoMS = ^ ^^CoMS (PCoMS ) • 

Pci,Ms{-)G7'<^„Ms PprMs(-)G7'*„s PCoMS {• ) ePcoMS 

In the above, 9^cums(Pcums) denotes a set of achievable rates when the channel is characterized by the joint 
probability distribution function Pcu^S' ^^'^ similar definitions apply for the other notations used. The region 
^CiiMs(or ^PiMS or ^Coms) is an achievable rate region for the channel C^cuusi^^ ^pms or Ccoms), i-c, 9^cuMs(or 
^PrMS or IHcoMs) ^ ^cuMS (or e:*,MS or CcoMs). 

Proof: We employ the standard technique of combining GP's binning principle Q and superposition coding 
||9l to prove the coding theorem and derive a set of achievable rates for each of the channel models. We show the 
proof for the channels C^^ms ^''^'^ '^PrMS- ^he proof for the remaining three channels (C^^jyfg , Cp^^s ^'^^ Ccoms) are 
along similar lines and are omitted. 

Proof of achievability for the channel C^^^^: The proof is presented in four parts, namely, codebook generation, 
encoding, decoding and analysis of probabilities of decoding errors at the three receivers. We start with the codebook 
generation scheme. 

A. Codebook Generation 

Let us fix p{.) S 'PcuMS- Generate a random time sharing codeword q, of length n, according to the distribution 
W^=iP{qi)- Generate 2"^" independent codewords W(j), according to \\^^iP{wi\qi). For every w(j), generate 
one codeword Xi(j) according to nr=i^'(^i«l^*0)' ^«)- 
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For r = 1,2, generate 2"(^2^+^(^'^^l'3)+4e) independent codewords Ut-(Zt-), according to YVi=iPiuri\qi). For 
every codeword triple [ui(Zi),U2(Z2), w(j)], generate one codeword X2{li,l2,j) according to 

UA=iP{x2i\uu(h),u2i{l2),Wi{j),qi). Uniformly distribute the 2"(^^-+-f(^;f^-IQ)+4^) codewords U^(/^) into 2"-^=- 
bins indexed by A;,- G |l, . . . ,2"^^^} such that each bin contains 2"(^(^''^^l'5)+4e) codewords. 

For p = 1,3, generate 2"(^-'''+-^(^'^i'^2'^pl*5)+'^'^) independent codewords Vp(tp), according to YYi=iPi'^pi\^i)- 
For every codeword quadruple [vi(ti), V3(t3), Ui(/i), 02(^2), w(j)], generate one codeword X3{ti,t3,li,l2,j) ac- 
cording to Ui=iPix3i\vii{ti),V3i{t3),uu{h),U2i{l2),Wi{j),qi). Distribute 2"(«3.+/(H/,c/i,[/2;l/,|Q)+4.) codewords 
Ypitp) uniformly into 2^*^=*" bins indexed by rp g{1, . . . , 2"^^"} such that each bin contains 2"(''^(^'^i'^=;^f l<3)+4e) 
codewords. The indices are given by j G (l, . . . , 2"^" }, G (l, . . . , 2"(^^=+^(^;f^-l«)+4e)} and ip G {1, . . . , 

2n(R33+I{W,UuU2;V,\Q)+4e)j^ 

B. Encoding & Transmission 

Let ^e"^ be a typical set. We will be using the notation Ai"'^ to describe a typical set over many different random 
variables, but the definition will be clear from the context. 

Let us suppose that the source message vector generated at the three senders is (77111,777-21,77122,^131,7/133) = 
(j, ki,k2,ri,r3). At the encoders, the first component is treated as the message index and the last four components 
are treated as the bin indices. S2 looks for a codeword ui(Zi) in bin ki and a codeword U2(Z2) in bin k2 such that 
(ui(Zi), w(j),q) G Ag"^ and (u2(Z2), w(j), q) G Ai^\ respectively. S3 looks for a codeword vi(ti) in bin ri and a 
codeword V3(i3) in bin r3 such that (vi(ti),Ui(Zi),U2(Z2), w(j),q) G A^"^ and (v3(i3),Ui(/i),U2(/2), w(j),q) G 
Ai"\ respectively. <Si, S2 and S3 then transmit codewords Xi(j), X2{li,l2,j) and X3(ti,t3,Zi,Z2,i), respectively, 
through 77 channel uses. The transmissions are assumed to be synchronized. 

C. Decoding 

Recall that in C^^^, the primary receiver can decode the public parts of the non-pairing sender's messages, while 
the secondary receivers can only decode the messages from their pairing transmitters. The three receivers accumulate 
an 77-length channel output sequence: yi at TZi, ^2 at Tl2 and y3 at Tl3. Decoders 1, 2 and 3 look for all indices 
OMM), {hM) and {iiM), respectively, such that (w(j),ui(Zi), vi(ti),yi,q) G A'f^, (ui(/i),U2(f2),y2,q) € 
Ag"^ and (vi(ii), V3(t3),y3,q) G A^J^\ If j in all the index triples found are the same, TZi declares 77111 = 3, for 
some Zi and ti. If l\ in all the index pairs found are indices of codewords ui(Zi) from the same bin with index 
ki, and I2 in all the index pairs found are indices of codewords U2(Z2) from the same bin with index k2, then 7I2 
determines (77121, 77122) = (^i, ^2)- Similarly, if ii in all the index pairs found are indices of codewords Vi(ti) from 
the same bin with index ri, and 13 in all the index pairs found are indices of codewords ¥3(^3) from the same 
bin with index 7-3, then 7^3 determines (77731,77733) = (fijfs). Otherwise, the receivers 7l\, TZ2 and 7^3 declare an 
error. 
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D. Analysis of the Probabilities of Error 

In this section we derive upperbounds on the probabilities of error events which could happen during encoding 

and decoding processes. We assume that a source message vector (mn, 77121, ^^-22 , "'tis! , ^^-33) = (j, ^i, ^2, ''3) is 
encoded and transmitted. We consider the analysis of the probability of encoding error at senders ^2 and iSs, and 
the analysis of the probability of decoding error at each of the three receivers T^i, 7I2, and 7^3 separately. 



First, let us define the following events: 
(i)£;,,,^{(W(i),Ui(Zi),q)G4"^}, 

(n)£;,,,^{(W(i),U2(Z2),q)e4"^}, 

(m) E^i^i^t^ ^ {(W(j),UiGi),U2(/2),Vi(ti),q) £ A^"^}, 

{iv) E^ij^t^ ^ {(W(i),Ui(/i),U2G2),V3(t3),q) G 4"^}, 

(v) E,i,t, ^ {(W(j),Ui(/i),Vi(ti),Yi,q) G A^")}, 

[vi) Eij^ ^ {(Ui(/i),U2(/2), Y2,q) G A^^^], 
{vii) Et^t, ^ {(Vi(ti),V3(t3),Y3,q) G 4"^}. 

= complement of the event E(^ y Events (i) — {iv) will be used in the analysis of probabihty of encoding error 
while events {v) — {vii) will be used in the analysis of probability of decoding error. 

1) Probability of Error at the Encoder of S2: An error is made if (a) the encoder cannot find a Ui(Zi) in the 
bin indexed by ki such that (w(j),ui(Zi),q) G A^J^^ or (6) it cannot find a U2(/2) in the bin indexed by k2 such 
that (w(j),U2(/2),q) £ ^e"^- The probabihty of encoding error at S2 can be bounded as 

Pe,S. <P{ n (W(i),Ui(/i),q) i 4") I + P I fl (W(i),U2(/2),q) ^ 4"^ ) , 
\Ui(ii)ebin(fci) / \u2(«2)ebin{fe) / 

< (1 - P(^,,))^"""'"^""^'^ + (1 - PC^,,))""""""'" , 

where P(.) is the probabihty of an event. Since q is predetermined, and w and ui are independent given q, 

P{Ejh) = E = w|q)P(Ui(ii) = ui|q) 

{w,Ui,q)eA<"' 

> 2n(H{W,Ur\Q)-e)2-n{H{W\Q)+e)2-n{H{U^\Q)+e) ^ 2-"(-f(^;^il'3)+3e)_ 

Similarly, P{Eji^) > 2-"(^(W';'^2|Q)+3£)_ Therefore, 

p^^ < (1 - 2-"(''"(^''^il'3)+3^))2"'"*^^'''"''+*'^ + (1 - 2~"(-^(^'^=l'5)+^^))^""'"'''''"''"^'"' 

Now, 

(1 - 2~"(^(^;'^il'3)+3e))2"(-f("''^il«'+'''' ^ ^2"(-f(»'i^il«)+''')ln(l-2-"(^(»'it/iiQ)+3e)) 

^ ^2"(^('^i'^ilO)+''«)(-2-"f^<^'^il'3>+^^') 

= e . 

Clearly, Pg 5^ — >^ as n — > 00. 
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2) Probability of Error at the Encoder of S3: An error is made if (a) the encoder cannot find a Vi(ti) in the 
bin indexed by ri such that (w(j),Ui(/i),U2(^2)5Vi(ti),q) G Ai^^ or (6) it cannot find a ¥3(^3) in the bin indexed 
by rs such that (w(j),ui(/i),U2(/2)) V3(t3),q) G A^/^\ The probability of encoding error at ^3 can be bounded as 

Pe,s, <pi n (W(j),Ui(/i),U2(/2),Vi(ti),q) ^ 

\Vi(ti)Gbin(ri) 



+^ n (W(i),Ui(/i),U2G2),V3(t3),q) ^ 4" 

\V3(t3)ebin(r3) 

< (1 - F[Ejij^tJ) + (1 - Pi^jlihh)) 



Since q is predetermined, we have, 

= E ^('^(•^■) = = Ui,U2(/2) = U2|q)P(Vi(ti) = vi|q) 

(w,Ui,U2,Vi,q)GA'"' 

> 2niHiW,Ui,U2,Vi\Q)-€))2-n(H{W,Ui,U2\Q)+e)2-niHiVi\Q)+t) 

^ 2-"(^(^'f^i'f^2;VilQ)+3e) 

Similarly, P{Ejij^tJ > 2-"(AW^,c/i,c/2;V3|Q)+3e)_ Therefore, 

< _ 2-"UWC/i,C/2;Vi|Q)+3e)\ _ 2-n{I{W,Ui,U2;V3\Q)+3€)Y 

Proceeding in a way similar to the encoder error analysis at ^2, we can show that Pe,S3 — ?• as n — )• 00. 

3) Probability of Error at the Decoder of TZi: There are two possible events which result in errors: (a)The 
codewords transmitted are not jointly typical i.e., Ej^^^^ happens or (6) there exists some j 7^ j such that E'.j ; 
happens. Note that li need not equal li, and ti need not equal ti, since TZi is not required to decode li and ii 
correctly. The probability of decoding error can, therefore, be expressed as 

Applying union of events bound, (j6]) can be written as, 

nl<^'K,) + p(u),,£i,= ,0 



2niRii+B,n+I(W,UuU2;Vi\Q)+ie)p ^ ^ \ _^ 
2niRii+R2i+IiW;Ui\Q)+4e+R3i+IiW,Ui,U2-yi\Q)+4,e)p ^ / 
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P (^j/^i J , P (e^i ^ ) , -P (e,^ I ) and P {e^-- , ) can be upper bounded as follows. 

V jhti J — ' 

p(e ' \ < 2-"(^(^''^i;^i'^il<3)+^(^;C^i|Q)-4e) 

V jiltiJ - 

V jhtij - 

P (e < 2-"(^W^i'^i;^il<3)+JWC/i;Vi|Q)+7(W;!7i|Q)-5e) 

v jiJJ - 

Substituting these in the probabihty of decoding error at TZi, we have, 

=e + 2'^^ii2-"(^(^''^i''^i''^i|'5)-3^) + 2"(-f^ii+-^2i+i(VV;t/i|0)+4e)2-n(/(W,C/i;Vi,yi|Q)+7(W;C/i|Q)-4e) _^ 

2n(i?ii+il3i+/W[/i,;72;yi|(3)+4e)2-n(/(M/,yi;C/i,yi|Q)+/(M/;yi|Q)-4e) _^ 
2n{Rii+R2i+I{W;Ui\Q)+4€+R3i+I{W,UuU2;Vi\Q)+4e)2-n{I{W,Uiyi;Yi\Q)+I{^^ 

(n) 

Pg^^ ^ as n ^ oo if Pn, R21 and P31 satisfy the following constraints: 

Ru < I{W;U^,Vi,Yi\Q) (7) 

i?ii + i?2i < W?7i;Vi,yi|g) (8) 

i?ii + < I{W, Vi;UuYi\Q)+ I{W; Vi\Q) - I{W, C/i, C/2; Vi\Q) (9) 

Pii + P21 + P31 < W Ui,Vi;Yi\Q) + /(W, C/i; FilQ) - I{W, U^, U2; Fi|Q). (10) 

4) Probability of Error at the Decoder ofTl2: The two possible error events are: (a) The codewords transmitted 
are not jointly typical i.e., Efj^ happens or (6) there exists some (j^i / li,i2 / such that E^j^ happens. The 
probabihty of decoding error can be written as 

Applying union of events bound, (11) can be written as, 

Pe,TZ2 - P {P'lik) + P iy{hi^h,U¥^h)P"hi2) 

<P{Efi)+ 2"(^"+^('^'^i''3)+'^') P{Ei ; ) + 2"(^22+^(^'^^l'5)+4e)p(^^^ ^ 

_^2^{R2i+R22+I(W;U^\Q)+4e+I(W;U2\Q}+4e)pr^^ . y 

P{Ej-j^), P{E^jJ and P[E^j^) can be upper bounded as follows. 

PiE- ) < 2-"(-f('^i;t^2'^2l'3)-3e) 

p(p, I ) < 2-"(-f('^2;f^i''^2l'3)-3e)^ 

P{E' ' ) < 2-"(-f(^i'^2i'*'2|Q)+/(f/i;f/2)-4e) 
^ I1I2' — 
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Substituting these in the probability of decoding error at Tl2, we have, 

pW = 2"(^2i+-f(^i^il'3)+4e)2-"{^(f^i;'^2,y2|Q)-3£) _^ 2'"'iR22+I{W;U2\Q)+4.e)2-n(I{U2;UuY2\Q)-3e) _^ 

2n(B.2i+R22+IiW-,Ui\Q)+'it+IiW-,U2\Q)+4:e)2-niI{Ui,U2iY2\Q)+IiUuU2)-4:e) 

(n) 

Pg — )• as n — )• oo if R21 and R22 satisfy the following constraints: 

R21 < I{Ui;U2,Y2\Q) - I{W;Ui\Q) (12) 

R22 < IiU2;Ui,Y2\Q) - I{W;U2\Q) (13) 

R21 + R22 < I{Ui, U2; Y2\Q) + I{Ui; C/2IQ) - I{W; Ui\Q) - I(W; U2\Q). (14) 

5) Probability of Error at the Decoder ofTZ^: The two possible error events are: (a) The codewords transmitted 
are not jointly typical i.e., Ef^^^ happens or (6) there exists some (ti 7^ ti,t3 7^ ts) such that Efj^ happens. The 
probability of decoding error can be written as 

^iSs = ^ {Kts U ^ih^tuh^h)EiJ,) (15) 

Applying union of events bound, ([TS]) can be written as, 

— V tits) ' V tit3/ 

_^2"(^33+/{W/,C/i,C/2;V3|Q)+4e)p|-_gi^ , ^ _^ 2"(^='i+-^(^''^i''^2''^i|<3)+-R33+/(W',C/i,C/2;V3l<3)+8e)p|-_gi. ^ 

P{Ef^^^), P{E^j^) and P{Efj^) can be upper bounded as follows. 

PC^g. ) < 2-"(^(^i;^3,y3|Q)-3e) 
P{E^ I ) < 2-"(^(^3;Vi,X,|Q)-3e)^ 
PiE- - ) < 2-"(^(^i'^3;y3|Q)+/(Vi;y3)-4£) 

\ ilia J — 

Substituting these in the probability of decoding error at 7^3, we have, 

p{") _ , I nniR,i+I{W,UuU2;Vi\Q)+ie)r,-n{I{Vi;V3,Y3\Q)-3e) 
_^2"(^33+/(VK,!7i,C/2;y3|Q)+4e)2-n(/(V:,;yi,y3|Q)-3e) 
_^2"(^3i+-f(W,C/i,C/2;Vi|Q)+R33+/{H/,C/i,C/2;V3|Q)+8e) 
^ 2-"(^(^i .^3;'i^3 !<?)+/( Vi ;y3)-4e) 

(n) 

— )• as n — )• 00 if i?3i and P33 satisfy the following constraints: 

R31 < I{Vi;Vs,Y3\Q) - I{W,Ui,U2;Vi\Q), (16) 

P33 </(1^3;Vi,y3|Q)- WC/i,[/2;y3|Q), (17) 
R3i + R33<I{VuV3;Ys\Q)+IiVi;V3\Q)-I{W,UuU2;V3\Q)-I{W,Ui,U2;Vi\Q). (18) 
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The inequalities (7)-(10), (12)-(14) and (16)-(18) together constitute the achievable rate region for the channel C^rns- 

m 

The proof of achievability for the channel Cp^^^ is relegated to Appendix D. 

IV. The Gaussian Case 

In this section, we introduce the Gaussian CR channel to evaluate and plot the rate region for the different 
channel models considered in this paper. We also describe several extensions, in the form of corollaries, to the 
achievable rate regions described above. Finally, we derive some outer bounds to help us test the optimality of the 
coding techniques that we have employed to derive the achievable rate regions. 

A. The Gaussian CR channel 

The achievable rate regions described for the discrete memoryless channels can be extended to the Gaussian 
channels by quantizing the channel inputs and outputs 1371 . Let Cqq^^^^^ denote the cognitive Gaussian channel 
with cumulative message sharing, Cq ^^^^ the cognitive Gaussian channel with primary-only message sharing and 
Cq Q^yiv, the cognitive Gaussian channel with cognitive-only message sharing (G for Gaussian, CuMS, PrMS and 
CoMS are the same as before); t = 1,2. We show the extension for only one of the channel models - from C^^j^^ 
to r2 

The cognitive Gaussian channel is described by a discrete-time input X^, a corresponding output Yfc, and a 
random variable denoting noise at the receiver; k = 1,2,3. Following the maximum-entropy theorem ||38l . 
the input random variable X^] k = 1, 2, 3 is assumed to have a Gaussian distribution. The transmitted codeword 
Xfc = (xfci, . . . , Xkn) satisfies the average power constraint given by 

m^kf}<Pk; A: = 1,2,3, 

where E{.} is the expectation operator. The zero-mean random variable Zk is drawn i.i.d from a Gaussian distribution 
with variance N^] k = 1,2, 3, and is assumed to be independent of the signal X^. The Gaussian CR channel can 
be converted to a standard from using invertible transformations lITTI . llBQl . 

For the channel cuMS' '^^^^ ^i' ^2> Vi and V3 as the random variables (RV) which describe the sources 
at the transmitters. We also some consider additional RVs - W, Ui, U2, Vi and V3 - with the following statistics: 

. VF~AA(0,Pi), 

. Ui ~ 7V(0, TP2), U2 ~ AA(0, fPa), with r + f = 1, 

. Vi ~ 7V(0, kPs), V3 ~ 7V(0, kPs), with k + k = 1. 
Further, 

. W = W, 

. Ui = Ui + aiXi, U2 = U2 + (^2X1, 

. Vi = Vi + 03X1 + P1X2, Vz = % + a^Xi + P2X2, 
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where the input RV's Xx, X2 and X3 are given by Xi = W, X2 = Ui + U2 and X3 = Fi + V3. Notice that W, 
Ui, U2, Vi and V3 are mutually independent. Therefore, Xi ~ A^CO, Pi), X2 ~ ^{0, P2) and X3 ~ M{0, P3). 
The values of r and k are randomly selected from the interval [0, 1]. The values of ai, 02, as, 04, /3i and (32 are 
repeatedly generated according to Af{0, 1). The channel outputs are 

Yi=Xi + 012X2 + aisXs + Zi, 
Y2 = 021X1 + X2 + 023X3 + Z2, 
= 031X1 + 032X2 + X3 + Z3, 

where Zi ~ A/^(0, Qi), Z2 ~ M{0,Q2) and Z3 ~ Ar(0, Q3) are independent additive noise, and Qi, Q2 and (53 
are noise variances when the input-output relations are represented in the standard form. Substituting for Xi, X2 
and X3, we get, 

Yi = W + ai2{Ui + U2) + ai3(Vi + V3) + Zi, 
Y2 = a2iW + {til + U2) + 023(^1 + + Z2, 
Y3 = a^^W + a32{Ui + U2) + V1 + V3 + Z3, 

where the interference coefficients ai2, 013, 021, 023, 031 and 032 are assumed to be real and globally known. The 
rate region IEH^ums the channel C^ums extended to its respective Gaussian channel model by evaluating 

the mutual information terms. To this end, we construct a covariance matrix and compute its entries. Let us define 
a vector G = (Yi, I2, ^z, W, Ui, U2, Vi, V3). The covariance matrix is given by 

cov(yi, Y2, Ys, w, Uu U2, Vi, V3) = E{e^e}. 

The entries of this covariance matrix are used to compute the differential entropy terms, which are further used to 

evaluate the mutual information. 

Theorem 4.1: Let T = (r, k, ai, ^2, eta, "4, /3i, /32). For a fixed T, let ^cuMsC"") achievable. The rate region 
0CuMS achievable for the Gaussian channel Cq q^j^^ with 

®CuMS = U^CuMsC"")- 

T 

Proof: Since the computation procedure is cumbersome and lengthy albeit straightforward, we do not provide 
the proof here. ■ 
The same procedure is followed to compute the mutual information terms for the remaining channel models - 

^G,CuMS' ^G,PrMs;* = 1' 2> and Cg,CoMS- 

B. Extensions 

The corollaries presented in this subsection arise because several important achievable rate tuples for the Gaussian 
CR channel can be readily identified, which leads to a larger overall achievable region. We have made use of the 
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fact that the cognitive transmitters can be used as relays, depending on their knowledge of the other user's message. 
It is important to note that the corollaries below only give some examples of rate points that are achievable, and 
the list is by no means exhaustive. Hence, although it is possible that the rate regions describe below can be further 

improved upon, a systematic way of doing so seems elusive, and is relegated to future work. Also note that the 
achievable rate points below are presented as separate corollaries for clarity of presentation; one could state them 
together as one single result as well. The proofs for some of the corollaries can be found in Appendix E. 

^G,CuMS- 

Corollary 4.2: Let ©cuMS the set of all points i?2i + -R22, -R31 + Rzz) where i?2i, -R22, -^31,-^33) is 

an achievable rate tuple of Theorem 4.1. Then, the convex hull of the region ©cums ^® points {R\^ 0, 0) and 
(0, i22)^3) achievable for the CQ^^^y^^ model, where 

f/Pi + |ai2| \/P2 + |ai3| /P3)' 

Q. 



Rl = 



-K2 
p* 




1 + 



Q2 + \a2z\ -P3 



-P3 

V3 



Corollary 4.3: Let ©cuMS "^^e set of all points (i?i,i?2i + ^22,^31 + ^33). where {Ri, R21, R22, R31, R. 



'33 j 



is an achievable rate tuple of Theorem 4.1. Then the convex hull of the region (S^ums points (i?J,0, r) 

and (0, i?2,?') are achievable for the Cq^^^ model, where 

/ 



R*, = 




Pi + \ai2\V^+ \ai3\ 



Qi + \ai3\^Pi- 



P2 + \a23\\ P 



Q2 + \a23fPi' 



where Pf' = P3 



^^-Ps-Pi\ypi^ e [0,P3]. 
Corollary 4.4: The convex hull of the region ©^ums ^^^^ points {Rl,r,0) and (0, r, is achievable for 



the Cq model, where 



R*. 



^log2 



1 + 



(^VP1 + \ai2\\[pf+ |ai3|V^) 



Qi + \ai2?Pt 
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where = (2^'' — 1)(Q2 + 1023^^3), = P2 — Pf^ and r is the minimum rate that ^2 is guaranteed to 
achieve. 

Corollary 4.5: The convex hull of the region ©cuMS ^^^^ points (0, iJgjO) and (0,0, iJg) is achievable for 
the Cq (^^^g model, where 

VP2 + |a23| VP3 



loga 1 + 



Q2 



Theorem 4.6: The convex hull of the region ©cums ^^^^ achievable points in the corollaries 
in an achievable rate region of the Cq ^^ums channel model. 

Proof: The convex hull is achievable by standard time-sharing arguments. 



results 



2) Cf 



G,PrMS- 



Corollary 4.7: Let ©pj^s be the set of all points i?2i + R22, R31 + R33) such that {Ri, R21, R22, ^31,^33) 
is an achievable rate tuple. Then the convex hull of the region ©pr^s with the points {R^, 0, 0) and (0, R2, R^) are 
achievable for the Cq p^^^ model, where 



R^ 



Tin 



RX 



- log 
2 ^ 



( (VPi + \ai2\VP2 + \au\VP3Y\ 
1 + ^ 



V 



Qi 



J 



log 1 + 



i log ( 1 + 



Q2 + \a23\ P3 

P3 



2 V Q3 + \a32\^ P2. 

Corollary 4.8: The convex hull of the region (Spj^g with the points {Rl,0,r) and (0, i?2,r) are achievable for 
the Cq pj.j^s model, where 



R*, 



K2 



log2 



1 + 



^A + |ai2|V^2 + |ai3|\/^'' 



351 



V 



2 

2 V Q2 + |a23| ^3 

-j^ / pcr2 

-logJl+ ^ 2p 

^ V Q3 + |a32| P2 



Qi + \ai3\^Pt 



where P^' = P3 - P^, ^Pt e [0, P3]. 



17 



Corollary 4.9: The convex hull of the region ©pj^s with the points {Rl,r,0) and (0,r, iJg) are achievable for 
the Cqp^^i^ model, where 



1 + 



Qi + |ai2|^P2^' 



olog2 1 + 



R*3 



log2 1 + 



Q2 + \a23\ P3 

P3 



Q3 + |a32| P2, 
where ^2^^ = P2 - P^', ^P^' e [0, ^2]- 

Theorem 4.10: The convex hull of the region ©pj^s with the achievable points in the corollaries 14.71 - 14^9] results 
in an achievable rate region of the Cq p^^^ channel model. 

Proof: The convex hull is achievable by standard time-sharing arguments. ■ 
^) Cg,coms' 

Corollary 4. 1 1 : Let ©coms be the set of all points [Ri, R2, R31 + -R33) such that i?2 5 ^31, ^33) is an 
achievable rate tuple. Then the convex hull of the region ©coms with the points {Rl,0, 0), (0, R2, 0) and (0, 0, 
are achievable for the Cg coms model, where 



Rl 



r?* 



Rt 



log2 



log2 



/ (VPi + M Vp- 

1 + 

V 



Qi + |ai2| P2 



I 



1 + 



^2 + |a23| 



Q2 + |a2i| P\ 



log2 ( 1 + ^ 



Corollary 4.12: The convex hull of the region ©coms with the points (i?J,0,r), (0, i?2)^) ™d (0)0;'") are 
achievable for the Cg,coms model, where 



R\ 



log2 



1 + 



^+|ai3lA/^3^^ 



\ 



Qi + |ai2|'P2 + |ai3|'^f^ 



75* 

-/To 



log2 



1 + 



'P2 + \av3\\P\ 



Q2 + |a2i|'^i + |ai3|'^f' 



V 



log2 1 + 



P^ 



where P^' = P^^ = P3 - P^, \/Pt G [0, ^^3 
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Theorem 4.13: The convex hull of the region ©coms with the achievable points in the corollaries 14. 1 1 1 an( j4. 121 
results in an achievable rate region of the Cq coms channel model. 

Proof: The convex hull is achievable by standard time-sharing arguments. ■ 

C. Outer Bounds 

The outer bound presented in this paper is inspired by the one found in Q. For the channel models considered in 
this paper, let us consider the scenario where the transmitters cooperate in a bidirectional manner, i.e., every sender 
knows the message of every other sender in a noncausal manner. In such a scenario, our channel models reduce to 
a multiple antenna broadcast channel (MIMO-BC) with one sender having three antennas and three receivers with 
one antenna each. Since bidirectional message-sharing is tantamount to additional information at the transmitters, 
the achievable rate regions can be enlarged. Further, this enlarged region also turns out to be the capacity region of 
the MIMO-BC (see l40ll ') and is an outer bound to our achievable rate regions. Unfortunately, the capacity region 
for the MIMO-BC is neither concave nor convex, making its computation difficult. We therefore resort to duahty 
results of the broadcast (BC) and the multiple access channels (MAC), reported first in |14T1. 

Let P be the total power constraint for the MIMO-BC and Pi, P2 and P3 be the individual power constraint for 
the MAC. On the MAC channel, the rate achieved by user j is given by 



RmACJ — log2 



1=] 



K 

1+ HfPiH, 

i=j+i 



(19) 



where |yl| denotes the determinant of A; and the channel matrices are Hi = [1 ai2 ais], H2 = [021 1 023] and 

K 

H3 = [aai 032 1]; and I + Hf^PjHj is the interference experienced by the j*^ user. The MIMO-BC capacity 

i=j+i 

region with power constraint P is equal to the union of capacity regions of the dual MAC, where the union is 
taken over all individual power constraint. Pi, P2 and P3, such that P = Pi + P2 + P3. Therefore, 

Cbc{P,H)= U Cmac(Pi,J^2,P3;H^), (20) 

PuP2,p3.j:u p^=p 

where 

Cmac(-Pi, -P2, -P3; H"^) = Pmacj, (21) 

je{i,2,3} 

where Rmacj is given by (19). We thus obtain the capacity region of the MIMO-BC, which forms an outer bound 
for the channel models considered in this paper. Generally, this outer bound tends to be loose, since the MIMO-BC 
capacity region was obtained by allowing bidirectional (or complete) transmitter cooperation. As in [4|, the rates 
of individual users can be further bounded depending on the model (CuMS, PrMS or CoMS). 

1) In the case of CuMS, senders ^2 and ^3 have complete knowledge of the 5i's message and ^3 has knowledge 
of 52's message but not vice- versa. Note that, the rate of Si cannot be bounded by the interference-free case 
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where 012 = and 013 = 0. This is because unidirectional message sharing enables ^2 and ^3 to transmit the 
message of Si, thereby increasing the rate of Si beyond what is achievable with the 5i alone transmitting 
its message. Hence, rate Ri can upper bounded as follows. 

Ri < 2 log2 ^1 + J • (22) 

Similarly, the rate of ^2 cannot be bounded by the interference free rate as ^3 can use its knowledge of 52's 
message to enable ^2 increase its rate. Hence, the rate of ^2 can upper bounded as 

R2 < 2 log2 ^1 + J . (23) 

Finally, the rate of ^3 can be upper bounded by the interference free case. 

^3< ^log2 fl + ^V (24) 



Q: 

2) In the case of PrMS, although ^2 and ^3 have complete knowledge of Si's message, they do not have each 
other's message. Therefore, the bound on the 5i's rate given by (22) remains valid, as the ^2 and ^3 can use 
their knowledge of 5i's message to increase its rate. The bound on 53's rate is same as in the case of CuMS 
and is given by (24). Lastly, the 52's rate can be upper bounded by the interference-free case as follows. 

R2<1 log2 f 1 + ^ V (25) 



2 V Q2/ 

3) We upper bound now the sum rate of ^2 and ^3 by allowing full cooperation between their transmitters and 
pairing receivers. This results in a point-to-point MIMO channel, whose capacity is expressed as follows. 



1 ^ / p 2\ 

Cmimo = . ^^\p 2 ^ ^"^^ (^1 + -^J ' (26) 

where — is the signal-to-noise ratio associated with the i^^ channel, (jjS are the singular values and N 
represents the number of singular values of the MIMO channel. The optimum power allocation Pj can be 
obtained by the water-filling algorithm [38|. 
4) In the case of CoMS, sender ^3 has noncausal knowledge of Si and ^2. Therefore, the rates of Si and ^2 
cannot be bounded by the interference free scenario. The rate of Si can be upper bounded as follows: 

Ri < 2 log2 ^1 + J . (27) 

The rates of ^2 and ^3 can be upper bounded as in (23) and (24), respectively. To bound the sum rate of Si 
and ^2 we allow full cooperation between the transmitters and pairing receivers, resulting in a point-to-point 
MIMO channel. The capacity of this channel is given by ( [26l) . 
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V. Simulation Results and Discussion 

A. Simulation Setup 

We consider a 3-user Gaussian cognitive channel with CuMS, PrMS and CoMS for the simulations. We generate 
the source and channel symbols as described in Section IIV-AI 

1) The direct channel gains are an = 022 = 033 = 1- 

2) The interference coefficients ai2 = 013 = 021 = ^23 = Q^3i = ^32 = 0.55. 

3) The values of r and k are assumed to be randomly selected from the interval [0, 1]. 

4) The values of ai, 02, a^, 04, (3i and (^2 are repeatedly generated according to Af{0, 1). 

5) The noise variances Qi = Q2 = Q3 = 1- 

6) The transmit powers Pi = P2 = ^3 = 7.8dB or lOdB, as specified. 



B. Simulation Results and Discussion 

We now present the simulation results for the two and three-user scenario and draw several interesting observa- 
tions. 

1) Two-user channels: 

a) Figure |4] shows the plot of rate regions for the 2-user interference channels with various rate-splitting 
strategies. For convenience, we introduce the following notation. The senders are denoted Txi and Tx2, 
and the pairing receivers are denoted Rxi and Rx2, respectively. In Fig. lU^a), we consider the case where 
both Txi and Tx2 do not perform rate-splitting. In Fig. Sfb), Tx2 performs rate-splitting allowing Rxi 
to decode the public part of Tx2's message and cancels the interfering signals. In Fig. SJc), both Txi 
and Tx2 perform rate-spUtting which allows Rxi and Rx2 to decode the public part of the non-pairing 
transmitter's message and cancel out the interference by employing successive decoding. Therefore, it 
achieves the biggest rate region. Note that. Fig. Uc) is the Han-Kobayashi achievable rate region for 
the two-user interference channel |0. 

b) Figure |5] shows the achievable rate regions for the 2-user CR and interference channels. Here, Tx2 is 
assumed to be cognitive in the sense that it has noncausal knowledge of the messages and codewords 
of Txi. We consider two rate-splitting scenarios. In the first scenario, only Tx2 performs rate-splitting 
(Fig- ISb)), while in the second scenario both Txi and Tx2 perform rate-splitting (Fig. ISjc)). We show 
the Han-Kobayashi rate region for the classical interference channel in (Fig. [Ha)). Note that, in both the 
CR channels, Tx2 employs dirty paper coding and cancels out known interference from Txi. Therefore, 
it can transmit assuming that there is no interference due to Txi . Further, if Txi performs rate-splitting 
and encode part of its message at a possibly low rate, then Rx2 can decode and cancel out that part 
of interference, thus enlarging the rate region (Fig. ISJc)). The region shown in Fig. [Sfb) is the one 
presented in [10|. The outer bound that we have shown is the capacity region for the MIMO-BC. 
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2) Three-user channels with CuMS (channel C^^Mg): Here, we use the notation defined earlier for the three-user 
channels. 

a) In Fig. [6l we plot the rate of sender Si (Ri) versus the sum of the rates of ^2 and ^3 (i.e., R2 + R3) 
for the channel C^ums- figure, the outer bound, labeled BC — Outerbound, is the intersection of 
(I20I1 . (I22ll-(l24ll and (l26b . The innermost region corresponds to the achievable region given in Theorem 
4. 1 . The second largest region corresponds to Corollary 14.21 Note that our inner bound is for a specific 
rate-splitting strategy at the transmitters, which the outer bounds do not account for, due to which the 
outer bound may be loose in the examples considered in this paper More insight on the R2 and R3 
achievable via our scheme, and how it compares with the outer bound, can be obtained from the plots 
presented later in the discussion. 

b) Figure I2] shows plots of the rate of ^2 {R2) versus the rate of ^3 {R3) when Si achieves a minimum rate 
of 0, 1 and 1.5 bps/Hz. Although there is a gap between the inner bound and the outer bound. Corollary 
14.31 coincides with the outer bound at the corner points. Note that due to the noncausal knowledge 
of 5i's message, by employing dirty paper coding, the interference from Si can be eliminated at TZ^. 
Owing to this, with increase in rate Ri, the rate R2 does not decrease much for relatively small values 
of Ri. On the other hand, as the rate Ri increases, sender Si cannot achieve the required rate without 
senders ^2 and ^3 using their noncausal message knowledge to help 5i. Due to this, for higher values 
of Ri, the achievable rates of R2 and R^ decrease, as expected. Similar observations can also be made 
in the remaining cases presented below. 

c) In Fig. [8j we plot the rate of Si (Ri), versus that of ^2 iR2), when ^3 achieves a minimum rate of 
i?3 = 0, 1 and 1.5 bps/Hz. The gap between the inner bound and the outer bound is relatively small. 
The rate of ^2 does not decrease much as it employs dirty paper coding to eliminate interference when 
Si and 53 achieve relatively smaller rates. It can be observed that as ^3 achieves higher rates, the 
achievable rate region of the Si and ^2 shrinks. Also, when i?3 > 0, the rates achievable using the 
extensions provided by the corollaries lies completely above the rates achievable by the coding scheme 
in Sec. [nil which is due to the suboptimality of that scheme with respect to the achievable rates of Si 
and ^2 for a fixed R^. The rate of Si has a larger relative reduction compared to that of ^2, yet Si 
achieves a higher rate than ^2, as expected. Figure |9] shows a similar plot, but the rate of the Si is 
compared with that of ^3 instead of with ^2. As ^2 achieves a higher and higher rate, the rates of Si 
and 53 decrease, but the reduction is smaller than that in Fig. |8] Note that, in this case, the rate achieved 
by 53 matches the outer bound at the corner points when R2 = 0. 

3) Three-user channels with PrMS (channel Cp^j^g): 

a) In Fig. [TOl we plot the rate achieved by Si versus the sum rate of ^2 and ^3 along with the outer bound. 
Here, the outer bound is different from the Cp as the cutoff value used to bound R2 is different for 
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52- The plot labeled Outer bound is the intersection of the capacity region given by (|20] i. (|22] ). (I24l) 
- (l26l) . Also shown is the plot of Corollary 14.71 

b) In Fig. [TT] we plot the rates of ^2 and ^3, when Si achieves a minimum rate of Ri = 0, 1, 1.5 bps/Hz 
along with the plots of Corollary 14.81 As Si achieves a higher and higher minimum rate, the rates 
achieved by ^2 and Ss decrease, as expected. 

c) Fig. [12] shows the plot of the rate of Si versus that of ^2, when ^3 achieves a minimum rates of 0, 
0.4 Sand 0.8 bps/Hz. Here again, we see that the rates of Si and ^2 decrease with increasing rate of 
53. However, the decrease in 52's rate is relatively smaller than that of Si, but Si achieves a higher 
maximum rate compared to ^2. Figure [13] is similar to Fig. [121 except that the rate of ^3 is plotted 
versus that of Si, with a constraint on the minimum rate achieved by ^2. Similar trends as in Fig. [12] 
can be observed. 

4) Three-user channel with CoMS: 

a) In Fig. [I4l we plot the sum rate of senders Si and Si, Ri + R2, versus the rate of ^3, along with the 
outer bound and the plot of Corollary 14.1 11 The outer bound is the intersection of (|20l ). ((23), (1241 ). (|26l ) 
and (l27l ). 

b) Figure [TSl shows the plots of the rates of Si and ^2, when ^3 achieves a minimum rate of 0.5, 1 and 1.5 
bps/Hz, along with the plot of Corollary 14.121 Here again, we see that the rates of Si and ^2 decrease 
with increasing rate of ^3. However, compared to Figs. [12] and [13] the reduction in the size of the region 
is more symmetric i.e., both Ri and R2 simultaneously decrease, and roughly speaking, by the same 
relative amount. 

The inner bounds for the C^u^s and Cp^y^^ have not been plotted here. This is mainly because applying the 
Fourier-Motzkin elimination procedure on the rate region is a formidable task, given the number of inequalities 
involved. Nevertheless, one can expect (i) the achievable rate regions for C^^j^s and Cp^y^^ to be larger than that for 
C^uMs ^^'^ ^PrMS ^'^'^ (ii) §^P between the achievable rate region and the outer bound for C^y^s and Cp^^^^ to 
be smaller than that to C^ums ^^'^ ^pims respectively, because Si also employs rate-splitting strategy in the former 
case. 

As a concluding remark, note that, as mentioned above, the is a gap between the inner and outer bounds in 
all the cases plotted, although it is within two bits. There are a couple reasons for this. First, in the case of 
^cuMS ^^'^ ^PrMS' '^1 '^o^^ perform rate-splitting, thereby rendering the receivers of ^2 and ^3 vulnerable to 
interference caused due to Si's transmissions. In the case of Ccoms> neither Si nor ^2 performs rate-splitting, 
leading to poor interference management at all the receivers. However, several corollaries were derived based on 
the idea of allowing senders to dedicate (part of) their power for transmitting the primary sender's message, which 
expanded the achievable rate regions, and it was shown that the achievable rates matched with the outer bounds at 
several comer points. A systematic way of expanding the rate region by including the different coding schemes is 
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an open problem, which can be explored by future researchers. Second, the outer bounds were derived by taking 
the intersection of the capacity region with bidirectional sharing and the individual user rates with unidirectional 
sharing, and hence have a natural advantage over the purely-unidirectional model assumed in deriving the rate 
regions. Thus, the outer bound is general in the sense that it makes no explicit assumption about the decoding 
ability of the receivers resulting from rate-splitting at the transmitters; and in fact, the duality result implicitly 
assumes that the receivers can successfully decode the interfering signals to a large extent. 

VI. Conclusions 

In this paper, we introduced multiuser channels with noncausal transmitter cooperation and presented three 
different ways of message sharing which we termed cumulative message sharing (CuMS), primary-only message 
sharing (PrMS) and cognitive-only message sharing (CoMS). We modified the channel model to introduce rate- 
splitting to enable better interference management at the receivers. We then derived an achievable rate region for 
each of the channels by employing a coding scheme which comprised a combination of superposition and Gel'fand- 
Pinsker coding techniques. Numerical evaluation of the Gaussian case enabled a visual comparison between the rate 
regions and some simple outer bounds. We also presented some corollaries using which several achievable rate tuples 
for the Gaussian channel were readily identified, thereby enlarging the rate regions. Thus, we have demonstrated the 
effect of noncausal cooperation and rate-sphtting in multiuser networks; the former aims at improving the throughput 
capacity by conforming itself to the overlay cognitive radio network paradigm, while the latter addresses the issue 
of interference management at the receivers. Rate-constrained cooperation, wherein the cognitive radio estimates 
the message index transmitted by the primary user in a causal manner, is a more discernible formulation of the 
practical scenario and is an interesting open problem. 
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Appendix A 

The channel model C^ums symmetric, in the sense that all transmitters perform rate-splitting so that each 
receiver can decode and cancel out the interfering signals from the non-pairing senders. However, the receivers are 
not required to decode the public part of the non-pairing transmitter's message correctly. Considering these, for the 



channel C^ums' derive a total of 36 inequahties, as given below. 

Rio < I{Wo;W^,Uo,Vo,Yi\Q), 
Ru < I{Wi;Wo,Uo,Vo,Yi\Q), 
Rio + Rii< I {Wo, Wr,Uo,Vo,Y^\Q) + I {Wo; Wi), 
Rio + R20<I{Wo,Uo;Wi,Vo,Yi\Q) + I{Wo;Uo\Q)-I{Wo,Wi;Uo\Q), 
Rio + R30 < I{Wo, Vb; Wi, Uo, Yi\Q) + I{Wo; Vo\Q) - I{Wo, Wi, Uo, U2; Vo\Q), 
Ru + R20 < I{Wi, Uo; Wo, Vo,Yi\Q) + I{Wi;Uo\Q) - I{Wo, Wv, Uo\Q), 
Ru + R30 < I{Wi,Vo;Wo,Uo,Yi\Q) + I{Wr,Vo\Q) - I{Wo,Wi,Uo,U2;Vo\Q), 
Rw + Ru + R20 < I{Wo, Wi, Uo; Vo, Y^\Q) + I{Wo, Wy, Uo\Q) + I{Wo; Wi\Q) - I{Wo, Wr, Uo\Q), 
Rio + Ru + R30 < I{Wo, Wi, Vo; Uo, Yi\Q) + I{Wo, Wv, Vo\Q) + I{Wo; Wi\Q) - I{Wo, Wi, Uo, C/2; Vb|Q), 

Rio + R20 + R30 < I{Wo, Uo, Vo; Wi,Yi\Q) + I{Wo, Uo; Vo\Q) + I{Wo; Uo\Q) 

-I{Wo, Wi; Uo\Q) - I{Wo, Wu Uo, U2; Vo\Q) 
Ru + R20 + R30 < I{Wi, Uo, Vo; Wo, Fi|Q) + I{Wi, Uo; Vo\Q) + I{Wr, Uo\Q) 

-I {Wo, Wr,Uo\Q)- I {Wo, Wi,Uo,U2; Vo\Q) 
i?io + Ru + R20 + R30 < I{Wo, Wi,Uo, Vo;Yi\Q) + I{Wo, Wi, Uo; Vo\Q) + I{Wo, Wi; Uo\Q) + I{Wo, Wi\Q) 

-I{Wo, Wr, Uo\Q) - I{Wo, Wi, Uo, U2; Vo\Q), 
R20 < I{Uo; Wo, C/2, Vb, Y2\Q) - l{Wo, Wr, Uo\Q), 
R22 < I{U2;Wo,Uo,Vo,Y2\Q) - I{Wo,Wi;U2\Q), 
R20 + R22 < I{Uo, U2; Wo, Vo, Y2\Q) + I{Uo; - I{Wo, Wr, Uo\Q) - I{Wo, Wr U2\Q), 
Rio + R20 < I{Wo, Uo; U2, Vo,Y2\Q) + I{Wo; Uo\Q) - I{Wo, Wr Uo\Q), 
Rio + R22 < I {Wo, U2;Uo,Vo,Y2\Q) + I {Wo; C/2IQ) - I {Wo, Wr,U2\Q), 
R20 + R30 < I{Uo, Vo; Wo, U2,Y2\Q) + I{Uo; Vo\Q) - I{Wo, Wr Uo\Q) - I{Wo, Wi,Uo, U2; Vo\Q), 
R22 + R30 < I{U2, Vo; Wo, Uo, Y2\Q) + HU2; Vo\Q) - I{Wo, Wr C/2IQ) - I{Wo, Wi, Uo, U2; Vo\Q), 
Rio + R20 + R22 < I{Wo, Uo, U2; Vo, I2IQ) + I{Wo, Uo; U2\Q) + I{Wo; Uo\Q) 

-I {Wo, WrUolQ)- 1 {Wo, Wr C/2IQ) 

Rio + R20 + R30 < I{Wo, Uo, Vo; U2,Y2\Q) + I{Wo, Uo; Vo\Q) + I{Wo; Uo\Q) - 

I {Wo, WrUolQ)- I {Wo, Wi,Uo, U2;Vo\Q) 

Rio + R22 + R30 < I{Wo, U2, Vo; Uo,Y2\Q) + I{Wo, U2; Vo\Q) + I{Wo; C/2IQ) - 

I {Wo, WrU2\Q)- I {Wo, Wi,Uo,U2; Vo\Q) 
R20 + R22 + R30 < I{Uo, C/2, Vb; Wo, I2IQ) + I{Uo, U2; Vo\Q) + I{Uo; C/2IQ) 



-I {Wo, Wv,Uo\Q)- I {Wo, Wr,U2\Q)- I {Wo, Wi,Uo,U2; Vo\Q) 
Rio + R20 + R22 + R30 < I{Wo, Uo, U2, Vo;Y2\Q) + I{Wo, Uq, U2; Vo\Q) + I{Wo, Uq; C/2IQ) 
+I{Wo, Uo\Q) - -I{Wo, Wi; Uo\Q) - I{Wo, Wr, U2\Q) - I{Wo, Wi, Uo, U2; Vo\Q), 

R30 < I{Vo; Wo, Uo, V3, Ys\Q) - I{Wo, Wi, Uo, C/2; Vb|Q), 
R33 < m-. Wo, Uo, Vo, YslQ) - I{Wo, W,,Uo, U2; VslQ), 
R30 + R33 < I{Vo, V3; Wo, Uo, Y3\Q) + I{Vo; VslQ) 
-I{Wo, Wi, Uo, U2;Vo\Q) - I{Wo, Wi, Uo, C/2; l^alQ), 
Rio + R30 < I{Wo, Vo; Uo, F3, Ys\Q) + I{Wo; Vo\Q) - I{Wo, W,,Uo, C/2; Vo\Q), 
Rio + R33 < I{Wo, Vs; Uo, Vo, Y^IQ) + I{Wo; V3IQ) - I{Wo, Wi,Uo, U2; V3IQ), 
R20 + R30 < I{Uo, Vo; Wo, F3, Y^\Q) + I{Uo; Vo\Q) - I{Wo, Wr, Uo\Q) - I{Wo, Wi, Uo, C/2; Vo\Q), 
20 + R33 < I{Uo, V3; Wo, Vo, Y3\Q) + I{Uo; F3IQ) - I{Wo, Wv, Uo\Q) - I{Wo, W,,Uo, C/2; T^alQ), 
i?io + R20 + ^30 < I{Wo, Uo, Vo; V3,Ys\Q) + I{Wo, Uq; Vo\Q) + I{Wo; Uo\Q) 

-I{Wo, Wv, Uo\Q) - I{Wo, Wi,Uo, C/2; Vo\Q), 
Rio + R20 + R33 < I{Wo, Uo, V3; Vo, Ys\Q) + I{Wo, Uo; VslQ) + I{Wo; Uo\Q) 

-I{Wo, Wr, Uo\Q) - I{Wo, W,,Uo, C/2; F3IQ), 
R,o + R30 + R33 < I{Wo, Vo, V3; Uo, Ys\Q) + I{Wo, Vo; VslQ) + I{Wo; Vo\Q) 
-I{Wo, Wi, Uo, C/2; VblQ) - I{Wo, Wi, Uo, C/2; VslQ), 
R20 + R30 + R33 < I{Uo, Vo, V3; Wo, lalQ) + I{Uo, Vo; VslQ) + I{Uo; Vo\Q) 
-I {Wo, Wi;Uo\Q)- I (Wo, Wi,Uo,U2;Vo\Q) - I {Wo, H^i, C/q, C/2; F3IQ), 
Rio + R20 + R30 + R33 < I{Wo, Uo, Vo, V3; YslQ) + I{Wo, Uo, Vo; F3IQ) + I{Wo, Uo; Vo\Q) + I{Wo; Uo\Q) 

-I{Wo, Wv, Uo\Q) - I{Wo, Wi, Uo, C/2; VblQ) - I{Wo, Wi, Uo, U2; VslQ). 

The channel model Cq^^^ is not symmetric, in the sense that only senders ^2 and ^3 perform rate-splitting. This 
results in receiver TZi being able to decode the public part of the non-pairing sender's message, while receivers 7^2 
and TZs can only decode the message from the pairing transmitter. We have a total of 10 inequalities which are 
given below. 

Ru < I{W;Ui,Vi,Yi\Q), 
Rii + R2i<I{W,Ui;Vi,Yi\Q), 
Rii + R31 < I{W, Vi; U^,Yi\Q) + I{W; V^\Q) - I{W, C/i, C/2; Vi\Q), 
Rii + R21 + R31 < I{W, Ui,Vi;Yi\Q)I{W, Ui;Vi\Q) - I{W, Ui, C/2; Vi\Q), 



R21 < I{Ur,U2,Y2\Q) - I{W;Ui\Q), 
R22 < I{U2] t/i, I2IQ) - I{W; U2\Q), 
R21 + R22 < I{Uu U2; Y2\Q) + I{Ur, U2\Q) - I{W; Ui\Q) - I{W; C/2IQ), 

R31 < I{Vi;V3, Y3\Q) - I{W, Ui,U2; Vi\Q), 
R33 < I{V3; Vi,Y3\Q) - I{W, Ui,U2; V3IQ), 
R31 + R33 < I{Vi,V3; Ys\Q) + I{Vi- V3\Q) - I{W, i7i, C/2; ^slQ) - W UuU2\ Vi\Q). 

Appendix B 

An achievable rate region for the channel Cp^j^g is given by the following inequalities. The number of inequalities 
is the same as with the case of C^ums- Note that, the only difference between the two channel models is that they 
have different message-sharing schemes. 

Riq<I{Wo\Wi,Uo,Vq,Yi\Q), 
Rii<I{Wi-Wo,Uo,Vo,Yi\Q), 
Rio + Ru < I {Wo, Wv,Uo,Vo,Yi\Q) + 1 [Wo; Wi\Q), 
Rio + R2o<I{Wo,Uo;Wi,Vo,Yi\Q) + I {Wo ■,Uo\Q) - I{Wo,Wr,Uo\Q), 
Rio + R30 < I{Wo,Vo;Wi,Uo,Yi\Q) + I{Wo;Vo\Q) - IiWo,Wi;Vo\Q), 
Ru + R20 < I{Wi, Uo; Wo, Vo, Yi\Q) + I{Wi; Uo\Q) - I{Wo, Wr, Uo\Q), 
Ru + R30 < I{Wi,Vo;Wo,Uo,Yi\Q) + I{Wi ; Vb | Q) - I {Wo ,Wv,Vo\Q), 
Rio + Ru + R20 < I {Wo, Wi,Uo;Vo,Yi\Q) + I {Wo, Wi; Uo\Q) + I {Wo; Wi\Q) - I {Wo, Wi; Uo\Q), 
Rio + Ru + R30 < I{Wo, Wi, Vo; Uo, Yi\Q) + I{Wo, Wr, Vo\Q) + I{Wo; Wi\Q) - I{Wo, Wi; Vo\Q), 
Rio + R20 + R30 < I{Wo, Uo, Vo; Wi,Yi\Q) + I{Wo, Uo; Vo\Q) + I{Wo; Uo\Q) 

-I{Wo, Wi; Uo\Q) - I{Wo, Wi; Vo\Q) 
Rii + R20 + R30 < I{Wi, Uo, Vo; Wo, Yi\Q) + I{Wi, Uo; Vo\Q) + I{Wi; Uo\Q) 

-I{Wo, Wi;Uo\Q) - I{Wo, Wv, Vo\Q) 
Rio + Ru + R20 + R30 < I{Wo, Wi, Uo, Vo; Yi\Q) + I{Wo, Wi,Uo; Vo\Q) + I{Wo, Wi; Uo\Q) 

+I{Wo,Wi\Q) - I{Wo,Wi;Uo\Q) - I{Wo,Wi;Vo\Q) 
R20 < I{Uo; Wo, U2, Vo, Y2\Q) - I{Wo, Wi; Uo\Q), 
R22 < HU2; Wo, Uo, Vo, Y2\Q) - I{Wo, Wr, U2\Q), 
R2o + R22<I{Uo,U2;Wo,Vo,Y2\Q)+I{Uo;U2\Q)-I{Wo,WrUo\Q)-I{Wo,WrU2\Q), 
Rio + R20 < I{Wo, Uo; U2, Vo, Y2\Q) + I{Wo; Uo\Q) - I{Wo, Wr Uo\Q), 
Rio + R22 < I {Wo, U2;Uo,Vo,Y2\Q) + I {Wo; C/2IQ) - I {Wo, Wr,U2\Q), 



R20 + Rso < I{Uo, Vo; Wo, C/2, 12IQ) + I{Uo; Vo\Q) - I{Wo, Wr, Uo\Q) - I{Wo, Wr,Vo\Q), 
R22 + R3o<IiU2,Vo;Wo,Uo,Y2\Q) + I{U2;Vo\Q)-IiWo,Wi;U2\Q)-IiWo,Wi-Vo\Q), 
Rio + R20 + R22 < I{Wo, Uo, U2; Vo, Y2\Q) + I{Wo, Uo; C/slQ) + I{Wo; Uo\Q) 

-I {Wo, Wr,Uo\Q)- I {Wo, Wi; U2\Q) 
Rio + R20 + R30 < I{Wo, Uo, Vo; U2, Y2\Q) + I{Wo, Uo; Vo\Q) + I{Wo; Uo\Q) - 

I{Wo, Wi; Uo\Q) - I{Wo, Wv, Vo\Q) 
Rio + R22 + R30 < I{Wo, U2,Vo; Uo, I2IQ) + I{Wo, U2; Vo\Q) + I{Wo; U2\Q) - 

I{Wo,Wr,U2\Q) - l{Wo,Wr,Vo\Q) 
R20 + R22 + R30 < I{Uo, U2,Vo;Wo,Y2\Q) + I{Uo, U2;Vo\Q) + I{Uo; U2\Q) 
-I {Wo, Wi;Uo\Q)- I {Wo, Wi;U2\Q)- I {Wo, Wv, Vo\Q) 
Rio + R20 + R22 + R30 < I{Wo, Uo, U2, Vo; FslQ) + I{Wo, Uo, C/2; Vb|Q) + I{Wo, Uo; C/2IQ) 
+I{Wo, Uo\Q)- -I {Wo, Wi;Uo\Q)- I {Wo, H^i; C/2IQ) - I{Wo, Wr,Vo\Q) 

R30 < I{Vo;Wo,Uo,V3,Ys\Q) - I{Wo,Wi;Vo\Q), 
R33 < KV3; Wo, Uo, Vo, FalQ) - I{Wo, Wi;V3\Q), 
R30 + R33 < I{Vo, F3; W^o, Uo,Ys\Q) + I{Vo; Vs\Q) 
-I{Wo, Wv, Vo\Q) - I{Wo, Wv VslQ), 
Rio + < I{Wo, Vo; Uo, V3, Y^IQ) + I{Wo; Vo\Q) - I{Wo, Wv,Vo\Q), 
Rio + R33 < I{Wo, V3; Uo, Vo, Y3\Q) + I{Wo; V^IQ) - I{Wo, Wv VslQ), 
R20 + R30 < I{Uo,Vo;Wo,V3,Y3\Q) + I{Uo;Vo\Q) - I{Wo,WvUo\Q) - I{Wo,Wv,Vo\Q), 
R20 + R33 < I{Uo, V3; Wo, Vo, F3IQ) + I{Uo; V3\Q) - I{Wo, Wv Uo\Q) - I{Wo, Wv FalQ), 
Rio + R20 + R30 < I{Wo, Uo, Vo; V3, yalQ) + I{Wo, Uo; Vo\Q) + I{Wo; Uo\Q) 

-I {Wo, WvUo\Q)- I {Wo ,WvVo\Q), 
Rio + R20 + R33 < I{Wo, Uo, V3; Vo, Ys\Q) + I{Wo, Uo; ValQ) + I{Wo; Uo\Q) 

-I{Wo, Wv Uo\Q) - I{Wo, WvVslQ), 
Rio + R30 + R33 < I{Wo, Vo, V3; Uo, YslQ) + I{Wo, Vo; F3IQ) + W; Vo\Q) 

-I {Wo ,WvVo\Q) - I{Wo,WvV3\Q), 
R20 + R30 + R33 < I{Uo, Vo, F3; Wo, Y3\Q) + I{Uo, Vo; FalQ) + I{Uo; Vo\Q) 
-I{Wo,Wi;Uo\Q) - I {Wo ,Wi;Vo\Q)- I {Wo , ; V3 1 Q) , 
Rio + R20 + R30 + < I{Wo, Uo, Vo, Fa; ^alQ) + I{Wo, Uo, Vo; + I{Wo, Uo; Vo\Q) + I{Wo; Uo\Q) 

-I {Wo, Wi;Uo\Q)- I {Wo, Wi;Vo\Q)- I {Wo, W^i; F3IQ). 
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An achievable rate region for the channel Cp^MS given by the following inequalities. As before, the number of 
inequalities is same as that for the channel CcuMS- should also guard against direct comparison of the rate 
region equations of various channel models, since these channels are governed by joint distributions with different 
underlying factorizations. 

Ru < I{W;UuVi,Yi\Q) 
Rii + R2i<I{W,Ur,Vi,Yi\Q) 
Rii + R3i<IiW,Vi;Ui,Yi\Q) 
Ru + R21 + R31 < I{W, UuVi;Yi\Q) + I{W, Uv,Vi\Q) - I{W; Vi\Q), 

R21 < I{Ur,U2,Y2\Q) - I{W;U^\Q) 
R22 < I{U2; Ui,Y2\Q)- HW; U2\Q) 
R21 + R22 < I{Ui, U2;Y2\Q) + I{Ur, U2\Q)- I{W; Ui\Q) - I{W; C/2IQ), 

R31 < I{Vr,V3,Ys\Q) - I{W;V,\Q), 
R33 < I{V3;Vi,Ys\Q) - I{W;V3\Q), 
R31 + R33 < I{Vu ^3; Y^\Q) + I{Vv, V^IQ) - I{W; VslQ) - I{W; Vi\Q). 

Appendix C 

An achievable rate region for the channel Ccoms is given by the following inequalities. Here, sender Ss has 
noncausal knowledge of the messages and codewords of Si and S2, and performs rate-splitting. There is no rate- 
splitting at senders »Si and S2. 

Ri < I{W;Vo,Yi\Q), 
R1 + R31 < I{W,Vo;Yi\Q)+I{W;Vo\Q)-I{W,U;Vo\Q), 

R2<I{U;Vo,Y2\Q), 
R2 + R31 < I{U, Vo; Y2\Q) + I{U; Vo\Q) - I{W, U; Vo\Q), 
R31 < I{Vo; V3,Y3\Q)- I{W, U;Vo\Q), 
R33 < I{V3\ Vb, F3IQ) - W U- FalQ), 
R31 + R33 < I{Vo, V3; Ys\Q) + I{Vo; V3IQ) - I{W, U; Vo\Q) - I{W, U; ValQ). 



Appendix D 

Proof of achievability for the channel C^ms- 
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A. Codebook Generation 

Let us fix p{.) e V. Generate a random time sharing codeword q of length n, according to the distribution 

nr=i P{(li)- For 7 = 0, 1, T = 0, 2 and p = 0, 3: 

generate 2"-^^^ independent codewords W-y(j-y), G {1, . . . ,2^^^'<} according to ITILi P(^7iki)- For every 
codeword pair (wo(jo), wi(ji)), generate one codeword Xi(jo, ji) according to Y\d=iP{'^u\wi{j).,qi). 

Generate 2"'(^2^+^(^0'^i''^^l'5)+^^) independent code words Ur(Zr)> according to Y\!^=iP{uTi\qi). For every code- 
word tuple (uo(Zo),U2(^2),WoOo),wi(ji)), generate one code word X2(/o, ^2,io,ii) according to 
nr=i v{x'zi\uQi{lQ), U2iil2),woi{jo), wii{ji)qi). Uniformly distribute the 2"(«-+AW^o,m;C/.|Q)+46) ^^^^ ^q^^s U^(/^) 
into 2"-^=- bins indexed by fc^- G {1, . . . , 2"^=-} such that each bin contains 2'*(''^(^«'^i;^-l<3)+4e) codewords. 

Generate 2"(^='''+^(^°''^i'^''l'5)"'"^^) independent code words \p{tp), according to 111=1 For every code 

word tuple (vo(io), Val^s), Wo(jo), wi(ji)), generate one codeword X3(to, t3,io,ii) according to 
U.7=iPix3i\voi{to),V3iit3),woi{jo),wu{jM. Distribute 2"(«3p+/(W'o,w/i;y,|Q)+4c) ^^^e words V^(tp) uniformly 
into 2"^=*" bins indexed by Vp e{l, 2"^^"} such that each bin contains 2"(^(^0'^i;^''l<3)+4e) code words. The in- 
dices are given by G {1, . . . , 2^*^^^}, G {1, . . . , 2»(-R=-+AM^o,m;C/.|Q)+46)|^ G {1, . . . , 2'»(-R3p+-f{W^o,m;V^p|Q)+46)|_ 

B. Encoding & Transmission 

Let us suppose that the source message vector generated at the three senders is (mio, mn, m2o, 1^22,1^30, 17133) = 
ijo,ji:ko,k2,ro,r3). Si transmits codeword xi(jo,ji) with n channel uses. ^2 first looks for a codeword uo(^o) 
in bin ko such that iuo{lo),Wo{jo),Wi{ji),q) G A^J^\ and a codeword U2(/2) in bin /c2 such that 
(u2(^2)5 Wo(io)) Wi(ji), q) G Ae"''*. It then transmits X2(/o, ^2, JOi Ji) through n channel uses. Otherwise, ^2 declares 
an error. ^3 first looks for a codeword Vo(to) in bin vq such that (vo(to)i Wo(io))Wi(ji),q) G and a codeword 
V3(t3) in bin r3 such that (v3(t3), Wo(jo), Wi(ji), q) G It then transmits X3(to,t3,io, ji) through n channel 
uses. Otherwise, S3 declares an error. The transmissions are assumed to be perfectly synchronized. 

C. Decoding 

Recall the decoding capability assumed here (see Table 11). The three receivers accumulate an n-length channel 
output sequence: at TZi, y2 at TZ2 and y3 at 7^.3. Decoder I looks for all index tuples {jo, ji Jo, to) such that 

(wo(io)) wi(ji), uo(/o)5 ^0(^0)5 q) G Ai"'\ If jo and ji in all the index tuples found are the same, TZi determines 
{mio,mii) = (jOiJi) for some Iq and Iq. Otherwise, it declares an error. Decoder 2 looks for all index tuples 
{I0J2, jo,io) such that (wo(jo)) 00(^0)7 02(^2), ^0(^0)7 y2' Q) ^ Ac'^K If Iq in all the index pairs found are indices of 
codewords Uo(^o) from the same bin with index ko, and I2 in all the index pairs found are indices of codewords 
112(^2) from the same bin with index k2, then 7^2 determines (m2o,'Ti22) = (^Oi ^2)- Otherwise, it declares an error. 
Decoder 3 looks for all index pairs (to,4,^o,io) such that (woO'o),Uo(^"o), vo(io), V3(t3),y3,q) G If to in all 
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the index pairs found are indices of codewords vo(to) from the same bin with index ro, and £3 in all the index pairs 
found are indices of codewords V3(t3) from the same bin with index rs, then TZ^ determines {mso, mss) = (fo, rs). 
Otherwise, it declares an error. 

D. Analysis of the Probabilities of Error 

In this subsection we derive upper bounds on the probabilities of error events which happen during encoding 
and decoding processes. We assume that a source message vector (mio, ^n-n, 771-20, ^^-225 "iso, ^33) is encoded and 
transmitted. As before, we consider the analysis of probabihty of encoding error at senders ^2 and ^3, and the 
analysis of probabihty of decoding error at each of the three receivers TZi, TZ2, and TZs separately. 



First, let us define the following events: 

(i) Ej^jj^ 4 {(WoOo),Wi(ii),Uo(Zo),q) e 4"^}, 

(n) Ej,jj, 4 {(Wo(io),Wi(ji),U2(Z2),q) e 4"^}, 

(m) E,,j,to = {(Wo(jo),Wi(ii),Vo(to),q) G 4"^}, 

(iv) E,„,,t, ^ {(Wo(io),Wi(ji),V3(t3),q) G 4")}, 

(v) Ej,j,i,to = {(Wo(io),Wi(ji),Uo(/o),Vo(to),Yi,q) e A^^}, 

(vi) Ej^ij^t^ ^ {(Wo(io),Uo(/o),U2a2),Vo(to),Y2,q) G A^"^}, 

(vii) Ej^i^t^t^ ^ {(WoOo),Uo(/o),Vo(io),V3(t3),Y3,q) G 4"^}. 

E^^ = complement of the event E(^ y Events (i) — (iv) will be used in the analysis of probabihty of encoding error 
while events (v) — (vii) will be used in the analysis of probability of decoding error. 

1) Probability of Error at the Encoder of S2: An error is made if (a) the encoder cannot find Uo(Zo) in bin 
indexed by ko such that (woO'o); Wi(ji),Uo(/o),q) G ^e"^ or (6) it cannot find U2(/2) in bin indexed by ^2 such 
that (wo(jo); wi(ji),U2(/2),q) G A^J^\ The probability of encoding error at S2 can be bounded as 

Pe,S2 <P{ n (Wo(io),Wi(ii),Uo(/o),q) i 4"^ 
\Uo{io)ebin(A;o) 

+P I n (Wo(jo),Wi(ji),U2(/2),q) i 4"^ 
\U2(i2)ebin(fc2) 

< \^ - P[^jojilo)) + - P[^jojih)) 

Since q is predetermined, 

P{Em) = E ^(WoOo) = wo, Wi(ii) = Wi|q)P(Uo(/o) = Uo|q) 

(wo,Wi,Uo,q)€A<'') 

> 2n{H{Wo,Wi,Uo\Q)-e))2-n{H{Wo,Wi\Q)+€))2-n{H{Uo\Q)+e) ^ 2-'^(^0V°'^^'^°\Q)+^^) 

Similarly, P{Ej^j^i^) > 2-"(^(l^o,Wi;C/2|Q)+3e) Therefore, 

< (1 - 2-"(^(^°'^i;'^ol'3)+3e))2"(^<»'o,«'i;c/olQ)+4=) _^ _ 2-<^i'^o,W^■,U2\Q)+3e)^2^^'(^o.w^■.U2^Q}+i.) 
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Now, 



(1 - 2~"(-^(^0'^i'^ol'3)+^^))2"*''*"'°'"''''^''""^'''' = g2"<'f("'0'"'i'^ol'"+*=nn{l-2-"(-'<'*o."'i;C'ol«)+3.)) 

^ ^2"(nwo ,Wi,Uo\Q)+4e) ^_2-"(-r(»'o.»'i;C/ol'5)+3«)) 



Clearly, Pe.Sa — ?■ as n — ;> oo. 

2j Probability of Error at the Encoder of S?^: An error is made if (a) the encoder cannot find Vo(to) in bin 
indexed by ro such that (wo(io)) Wi(ji), Vo(to)) q) £ ^e"'' or (^) it cannot find V3(t3) in bin indexed by such 
that (woO'o)) Wi(ji), ¥3(^3), q) € Ae"^ The probability of encoding error at ^3 can be bounded as 

Pe,s, <P{ n (Wo(jo),Wi(ii),Vo(to),q) i 4"^ 
\Vo(io)ebin(ro) , 

+P n (Wo(jo),Wi(ii),V3(t3),q) i 

\V3(t3)ebin(r3) / 

, ,^ . .2"(-'<"'o.»'i;VolQ)+4.) . .2"(-'<"'o.»'i;V3lQ)+4.) 

< (1 - F{bjj„j^to)) +\^- Pl^jojits)) 

Since q is predetermined, we have, 

Pi^M) =I]^(Wo(io) = wo, Wi(ji) = wi|q)P(Vo(to) = vo|q) 

(wo,Wi,Vo,q)eAl"' 

> 2n(H(Wo,WuVo\Q)-e))2-n(HiWo,Wi\Q)+€)2-n(HiVo\Q)+e) ^ 2-"(^(W^O'W/i;Vo|Q)+3e) 

Similarly, P{Ej^j^t^) > 2-''(^(^o,Wi;V3\Q)+3e) _ Therefore, 

2"(^(»'o."'iiVolQ)+4,) 2"(-'(»'o.»'i;^3l'3)+4=) 



Proceeding in a way similar to the encoder error analysis at ^2, we get Pe,S3 — )• as n — )• cxd. 

3) Probability of Error at the Decoder oflZi: There are two possible events which can be classified as errors: 
(a)The codewords transmitted are not jointly typical i.e., E'j^j^i^ta happens or (6) there exists some jo 7^ Jo and 
3i 7^ 3i such that , ; ; happens. The probability of decoding error can, therefore, be expressed as 

ioji'oio 

= P (^loi./oto U ^h^3o3^^1. ^^^^ 

Applying union of events bound, (|28] ) can be written as, 

Pe% < P (^joii/oto) + P (^io^io,ji^ii^j„jJ„|J 



- P (Pjojiloto) +Y.P [PhjilotoJ ^YjP (^ioii/oto) + _ l^P (^ioji/oto) + (^jojiioto 

jo7^jo,to7^to ji^ji^ia^^lo ji^ji,io^to jo^jo Ji^ji,/o^/o 

jo7^jo,ji¥'ji,toT^to jo^jo,io¥'lo,ioJ^to ji¥'jiJoJ^lo,toJ^to 
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2n(ilio+R2o+J(W'o,W^i;C/o|Q)+4e)p Z'^. , 



\ jnjiktto ) 

2n(Rii+i?2o+/(Wo,Wi;!7o|Q)+4e)p _ \ 

\ jojiloto J 

,c^n{Rii+R3o+I{Wo,Wi;Vo\Q)+^e)pfp . ^ , 

2n{Rio+Rii+R2o+I(Wo,Wi;Uo\Q)+4£)p f ^ ^ 

\ jojiloto 



,r,n{Rio+Rii+R3o+I{Wo,WuVo\Q)+4e)p ( \ , 

'^^ ^ [^jojiloto J ^ 



2niRio+R2o+I{Wo,Wi;Uo\Q)+4.e)+R3o+IiWo,Wi;Vo\Q)+4.e)p 



\ Jojiloto 



+ 



2n(Rii+R2o+I{Wo,Wi;Uo\Q)+4e)+R3o+I{Wo,Wi;Vo\Q)+4€)p ( ^ ^ - - ) + 

V jojiloto J 

2niRio+Rii+R2o+HWo,Wi;Uo\Q)+'it)+R3o+I{Wo,Wi;Vo\Q)+'ie)p ( ^ . \ 

\ jojiloto J 

The probability of erroi events can be upper bounded as follows. 

p(E' ^ < 2-"(-f(^o;^i.'^0'^0''*^ilQ 

\ jojiloto J — 

p(E' ^ < 2-»Ww^i;W^o,%,Vo,>'i|Q 

\ jojiloto ) — 

p(E' ' \ < 2-'»Wl^o,m;C/o,Vo,yi|Q)+-f(M^o;m|Q: 

V jojiloto J — 

Pi E' ' ] < 2-"(-fW''^<';^i'^°''^il<3)+^(W'o;t/o|Q 

jojiloto — 



\ jojiloto J — 

< 2-n{I{Wi,Uo;Wo,Vo,Yi\Q)+I{Wi;Uo\Q 

< 2-n{I(Wi,Vo;Wo,Uo,Yi\Q)+HWi;Vo\Q 



P E 



jojiloto 



p (e~ ~ ' ] < 2-"('f(^°'^i''^<';^<''^ilQ)+^(^<''^i;'^<'l<3)+^(^<';^il<3 

\ jojiloto J — 

p(E' ' A < 2-"(W'^i'^o;f^O'^ilQ)+''"(^o,m;Vo|Q)+-f(W^o;Wi|Q: 

\ jojiloto ) — 

< 2-n{I{Wo,Uo,Vo;Wi,Yi\Q)+I{Wo,Uo;Vo\Q)+I{Wo;Uo\Q 

^ 2-n{I(Wi,Uo,Vo;Wo,Yi\Q)+I{Wi,Uo;Vo\Q)+I(Wi;Uo\Q 

p(E' ' - A < 2-"W^O'^i''^0'^o;^il'3)+AW'o,m,%;yo|(3)+J(l^o,Wi;i7o|g)+/(Tyo,l^i|Q 

\ jojiloto J — 



P E. . f f 

Jojihto 



P E 



jojiloto 



-3e) 

-36) 
-46) 
-46) 
-46) 
-46) 
-46) 
-56) 
-56) 
-56) 
-56) 
66) 



(n) 

Substituting these in the probability of decoding error at TZi, we note that — > as n — > oo if the following 
constraints are satisfied: 

Rio<I{Wo;Wi,Uo,Vo,Yi\Q), 

Ru < I{Wi;Wo,Uo,Vo,Y^\Q), 
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Rio + Rii<I{Wo,Wi-Uo,Vo^Yi\Q) + I{Wo;Wi\Q), 

Rio + R2(^<I{Wo,U^-WuVo,Yi\Q)+I{W^-U^\Q)-I{W^,Wi-UM, 
Rw + Rm<I{Wo,Vo;Wi,Uo,Yi\Q)+I{Wo-Vo\Q)-I{Wo,Wi-Vo\Q), 
R11 + R20 < I{Wi,Uo;Wo,Vo,Yi\Q) + I{Wr,Uo\Q) - I{Wo,Wr,Uo\Q), 
Ru + R30 < I{Wi ,Vo;Wo,Uo,Yi\Q) + IiWi;Vo\Q) - liWo ,Wi;Vo\Q), 
Rw + Ru + R2o < IiWo,WiMo-,Vo,Yi\Q) + I{Wo,Wr,Uo\Q) + I{Wo-,Wi\Q) - I{Wo,Wr,Uo\Q), 
Rio + Ru + R30 < I {Wo, Wi,Vo;Uo,Yi\Q) + I {Wo, Wr,Vo\Q) + I {Wo; Wi\Q) - I(Wo, Wr,Vo\Q), 
Rio + R20 + R30 < I{Wo, Uo, Vo; Wi,Yi\Q) + I(Wo, Uq; Vo\Q) + I{Wo; Uo\Q) 

-I{Wo,Wi;Uo\Q) - I{Wo,Wi;Vo\Q) 
Ru + R20 + R30 < I{Wi,Uo, Vo;Wo,Yi\Q) + I{Wi, Uo;Vo\Q) + I{Wi; Uo\Q) 

-I{Wo,Wi;Uo\Q) - I{Wo,Wi;Vo\Q) 
Rio + Ru + R20 + R30 < I{Wo, Wi, Uo, Vo;Yi\Q) + I{Wo, Wi, Uq; Vo\Q) + I{Wo, Wr, Uo\Q) 

+I{Wo,Wi\Q) - I{Wo,Wi;Uo\Q) - I{Wo,Wi;Vo\Q) 

4) Probability of Error at the Decoder of TZ2' There are two possible events which can be classified as errors: 
(a) The codewords transmitted are not jointly typical i.e., Ej^i^^^^^ happens or (6) there exists some lo / lo and 
I2 7^ I2 such that E~ . - happens. The probability of decoding error can, therefore, be expressed as 

jo'o'2io 

Pe% = P {Emu U ^(k^U.^i.)\i^a) (29) 
Applying union of events bound, (|29l ) can be written as, 

= p(E^ , , . ) + y p (e. f , A + p (e. , f A + y"p(E.ff,)+ y"p(E'n,) 
+ s"p(E~.,f.\+ y"p(E.f,f)+ y"p(E. , f f) + V p(E'.ffA + 
y p(E-.f,A+ y p(E.,,f)+ y p(E.fff)+ y p(E~.fff) 

Z-^ \ Jolohto J Z-^ \ Jolohto J Z-^ \ Joto«2to ) Z-^ \ Johhto J 

joy^jo,lo7^lo,toJ^to joy^jo^hj^hytoy^to io^/o,i2^i2,to^to jo7^jo,'o^'o, '2^^2,407^*0 

<p(Eh,f)+ 2"(^-+^(^«'^i;^«i«)+4^)p(^. + 

2n{R22+HWo,W^;U2\Q)+ie) p^^ . n 

^ joh-ihto' 

I 2n{^?2o+i?22+/(VKo,VKi;C/o|Q)+4£+/(VKo,VKi;t/2|Q)+4e)p/^ _ \ , 

,2<R^O+R22+I(Wo,WuU2\Q)+At)p/p^_^ . X 
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,2^{R2o+R3o+I(Wo,Wi-,Uo\Q)+4e+I(Wo,Wi-,Vo\Q)+4e)p(rj . . \ 

^ jolohio' 

, 2n{ii22+il3o+/(Wo,m;[/2|Q)+4e+7(Wo,Wi;Vb|Q)+4e)p/'^ . ^ \ 

^ jolohio' 

,2<R^o+R2o+R22+I{Wo,Wi,Uo\Q)+At+II^Wo,Wv,U2\Q)+ie)pt^^ _ ^1 I 

^ jolohto' 

2n(Rio+R2o+R3o+I(Wo,W,;Uo\Q)+4e+I(Wo,W^;Vo\Q)+4e)p(pj^ . _ x 

^ jolohio' 

,2MRw+R22+R3o+I{Wo,Wi-,U2\Q)+4e+I{Wo,Wi-,Vo\Q)+4e)p(^^ , ^ ^ 

jolohio' 

I 2'n(«2o+R22+K30+/(W-o,m;l/o|Q)+4e+7(Wo,m;C/2|Q)+4e+/(Vl/o,m;K)|Q)+4e)p/-_g _ \ 

^ jolohio' 

,2MRlO+R20+R22 + R30+IiWo,Wl-,Uo\Q)+i€ + I{Wo,WllU2\Q)+4e+I{Wo,Wu^^^ _ \ 

^ jolohio' 

The upper bounds on the probability of error events follow. 





P(^Jo 


o^2io 




^ 2-n(I(Uo;Wo,U2,Vo,Y2\Q) 


-3e) 




P(E - ) < 2-"(^('^2;^0'^0'^0''^2|Q) 

^ jolohto' — 


-36) 




^ jolohto' — 


-4e) 




jolohto' — 


-46) 




PiE- - ) < 2-'»W^0''^2;'^0'^°'^2l<3)+W;t/2|Q) 

^ jolohto' — 


-46) 




^ jolohio' — 


-46) 




^ jolohio^ — 


-46) 


P(E-. f f , 

^ Johhto 


^ < 2-n{I{Wo,Uo,U2-yo,Y2\Q)+I{Wo,Uo;U2\Q)+IiWo;Uo\Q) 


-56) 


P{E- t , f 

^ JO*0*2Co 


^ ^ 2-n(I{Wo,Uoyo;U2,Y2\Q)+I{Wo,Uo-yo\Q)+I{Wo;Uo\Q) 


-56) 


'^^'^ jolohio 


^ <• 2-nU(W'o,[/2,V'o;;7o,y2|Q)+/(Wo,C/2;yo|(3)+^(Wo;C/2|Q) 


-56) 


^^^johht 


^ < 2~"(-^('^°'^='^<''^<''^=l'5)+-f(t^o,C/2;Vo|Q)+-r(!7o;t/2|Q) 


-56) 


y-n{I{Wo,Uo,U2yo-,Y2\Q)+I{Wo,Uo,U2-,Vo\Q)+I{Wo,Uo-,U2\Q)+I{Wo,Uo\Q 


)-66) 



in) 

Substituting these in the probabihty of decoding error at 7?.2, we note that P^^^ — > as n ^ oo if the following 
constraints are satisfied: 

i?20 < I(C/o; Wo, U2, Vo, Y2\Q) - liWo, Wi; Uo\Q), 
R22 < I{U2;Wo,Uo,Vo,Y2\Q) - I{Wo,Wv,U2\Q), 
R20 + R22 < I{Uo, U2; Wo, Vo,Y2\Q) + I{Uo; U2\Q) - I{Wo, Wy, Uo\Q) - I(Wo, Wi; C/2IQ), 
Rio + R20 < I{Wo, Uo; U2, Vo, Y2\Q) + I{Wo; Uo\Q) - I{Wo, Wi; Uo\Q), 
Rio + R22 < I{Wo, U2; Uo, Vo, Y2\Q) + liWo; U2\Q) - I{Wo, Wv, C/slQ), 
R20 + R30 < I{Uo, Vo; Wo, U2, Y2\Q) + I{Uo; Vo\Q) - I{Wo, Wv, Uo\Q) - I{Wo, Wr, Vo\Q), 
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R22 + Rm<I{U2.V^;W^,Uo,Y2\Q) + I{U2;Vo\Q)- I {Wo , ; f/2 1 Q) - /(V^o, Wi-Vo\Q), 
Rw + R20 + R22 < I{Wo, Uo, U2; Vo,Y2\Q) + I{Wo, Uq; U2\Q) + I{Wo; Uo\Q) 

-I{Wo,Wi;Uo\Q) - I{Wo,Wi-U2\Q) 
Rio + R20 + R30 < I{Wo, Uo, Vo; f/a, I2IQ) + I{Wo, Uo; Vo\Q) + I{Wo; Uo\Q)- 

I{Wo, Wi;Uo\Q) - I{Wo,Wi;Vo\Q) 
Rio + R22 + R30 < I{Wo, U2, Vo; Uo,Y2\Q) + I{Wo, U2; Vo\Q) + I{Wo; [/2IQ)- 

I{Wo, Wi;U2\Q) - I{Wo,Wi;Vo\Q) 
R20 + R22 + R30 < I{Uo, U2, Vo; Wo, Y2\Q) + I{Uo, U2; Vo\Q) + I{Uo; U2\Q) 
-I{Wo,Wi;Uo\Q) - I {Wo ,Wr,U2\Q) - I{Wo,Wi;Vo\Q) 
Rio + R20 + R22 + R30 < I{Wo, Uo, U2, Vo; FalQ) + I{Wo, Uo, U2; Vo\Q) + I{Wo, Uo; C/2IQ) 
+I{Wo, Uo\Q) - I{Wo,Wi;Uo\Q) - I {Wo, Wi;U2\Q) - I{Wo,Wi;Vo\Q) 

5) Probability of Error at the Decoder ofTZ^: There are two possible events which can be classified as errors: 
(a) The codewords transmitted are not jointly typical i.e., Ejj^_^^^^^^ happens or (6) there exists some to ^ to and 
^3 / ^3 such that ; _ happens. The probability of decoding error can, therefore, be expressed as 

pj^ =p(E'r,.. I J U.,- f ^.-.E.^.A (30) 

Applying union of events bound, (l30l) can be written as, 

+ P (e: , , f] + Vp (e. ffA + Vp (e. f,f] + V p(e^. ffA + 

y ^f^-/.fU y p(E~-,ff)+ y p(E ftf)+ y p(E^iff) 

jo^jojloi^lottsy^ts io7^jo,to^to, 437^*3 7^^0,4 7^*0 1*3 7^*3 io7^io,^o7^'o,to7^to,i37^t3 

<P(E^ ^ _i_ 2'^(^3o+-f(VKo,Wi,r/o,r/2;Vo|Q)+4e) p/TTi , \ 

_L9™(fl33+-f(VKo,m,r/o,C/2;F3|0)+4e)p/p _ x 
_^2"(«3o+iJ33+/{VKo,iyi;yo|Q)+4e+/{iyo,iyi;V'3|Q)+4£)p^^ ; £ £ ) + 
2n(i?io+-R30+/{Vl/'o,Vl/i;Ki|Q)+4£) pi' en. . \ , 

2n(i?2o+i?30+-f(VKo,m;C/o|Q)+4e+/{lVo,Vl/i;yo|Q)+4£) p/cn _ \, 
2n{R2o+R33+I{Wo,Wi;Uo\Q)+4.e+I{Wo,Wi;V3\Q)+ie)p(^ ^ \ , 
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2n{Rio+R30+R33+I{Wo,WuVo\Q)+4e+I{WQ,Wi;V3\Q)+4e)prp.^ - O + 
2n{R2o+R3o+R33+I{Wo,Wi-,Uo\Q)+4e+I{Wo,Wi;Vo\Q)+4e+I{Wo,Wi;V3\Q)+^^^ - - - ) + 

2n[Rw+R2o+R3o+R33+I{WoyV^■,Uo\Q)+4e+I{WoyVryo\Q)+4e+I{Wo^V^^^ _ \ 

The probabilities of enx)r events can be upper bounded as follows. 



P(E- - ) < 2-"(^(^«;^«'^«'^3'^3l'3 
P(E- - ) < 2-"(^(^'''^«''^«'^«'^''IQ 
P(E- - -)< 2-"W^O'^3;W^o,%,>3|(9)+/(Vo;V'3|Q 
P(E' - ) < 2-"(-f(^<''^°;^°'^3,'K3|Q)+-f(W^o;Vo|0: 

^ jolotots' — 

P(E' - ) < 2-"(Wy3;?7o,Vb,y3|Q)+i'W;V3|Q 

P(E - - ) < 2""('^('^°'^°'^°'^3,"i^3|<3)+/(C/o;yo|Q 

V joloiots' — 

P(E - - ) < 2-"(''"(^'''^!';^«'^°'^=*l<3)+''"(t^o;V^3|0: 

V 3oloiot3' — 

P(E' - - )< 2-'»(''"(^«'^<''^<';^3,Y3|Q)+/(Wo,C/o;yo|Q)+/(Wo;!7o|Q 

^ jolotots' — 

P(E- - ')< 2-"(-^(^°''^'''^3;Vo,"i^3|<3)+/(Wo,C/o;V3|(3)+/(Wo;[/o|Q 
P(E' ' 'X 2-"(-f(^0'^0'^3;C/o,V'3|Q)+-r(W^o,Vb;y3|0)+-f{W^o;Vo|Q: 

^ jolotots' — 

P(E' - - ) < 2-"(-f('^«'^0'^3;Wo,ii)|Q)+-f{t/o,Vo;V^3|Q)+J(C/o;Vo|Q: 
P(E'. - - ) < 2-"(^(^°''^°'^°'^3;y3lQ)+/(H^o,i7o,Vo;\4|Q)+/W,!/o;V'o|Q)+/(Wo;i7o|^ 



-36) 

-3e) 
-4e) 

-46) 
-46) 
-46) 
-46) 
-56) 
-56) 
-56) 
-56) 
66) 



(n) 

Substituting these in the probabihty of decoding error at TZ^, we note that P^J, — > as n ^ oo if the following 
constraints are satisfied: 

Rso < I{Vo; Wo, Uo, Vs, YslQ) - I{Wo, Wv, Vo\Q), 
R33 < m-, Wo, Uo, Vo, YslQ) - I{Wo, Wi; F3IQ), 
R30 + R33 < nVo, V3;Wo,Uo,Y3\Q) + I{Vo; 

-I{Wo, Wi; Vo\Q) - liWo, Wi; VslQ), 
Rio + R30 < I{Wo, Vo; Uo, V3, YslQ) + I{Wo; Vo\Q) - I{Wo, Wv, Vo\Q), 
Rio + R33 < I{Wo, F3; Uo, Vo, FslQ) + I{Wo; Vs\Q) - I{Wo, Wr, V^IQ), 
R2o + R30<I(.Uo,Vo;Wo,V3,Ys\Q) + I{Uo;Vo\Q)-I{Wo,Wi;Uo\Q)-I{Wo,Wi;Vo\Q), 
R20 + R33 < I{Uo, V3; Wo, Vo, YslQ) + I{Uo; F3IQ) - Wv, Uo\Q) - I{Wo, Wv, V^IQ), 
Rio + R20 + R30 < I{Wo, Uo, Vo; V3, Ys\Q) + I{Wo, Uo; Vo\Q) + I{Wo; Uo\Q) 
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-I{Wo,Wr,Uo\Q) - IiWo,Wi;Vo\Q), 
Rw + R20 + R33 < I{Wo, Uo, V3; Vo,Ys\Q) + I{Wo, Uq; V^IQ) + I{Wo; Uo\Q) 

-I {Wo, Wi;Uo\Q)-I(Wo,Wi;Vi\Q), 
Rio + R30 + R33 < I{Wo, Vo, F3; Uo,Y3\Q) + I{Wo, Vo; Vs\Q) + I{Wo; Vo\Q) 

-I{Wo,Wi;Vo\Q) - I {Wo ,Wi;V3\Q), 
R20 + R30 + R33 < I{Uo, Vo, V3; Wo, Y^IQ) + I{Uo, Vo; V^IQ) + I{Uo; Vo\Q) 
-I{Wo,Wi;Uo\Q) - I{Wo,Wi;Vo\Q) - I{Wo,Wi;V3\Q), 
Rio + R20 + R30 + R33 < I{Wo, Uo, Vo, Vs; Y^IQ) + I{Wo, Uo, Vo; VslQ) + I{Wo, Uo; Vo\Q) + I{Wo; Uo\Q) 

-I{Wo,Wi;Uo\Q) - I {Wo ,Wi;Vo\Q)-I{Wo,Wi;V3\Q). 

Appendix E 

Here, we provide the proofs for some of the corollaries stated in Section IV. The proofs for the remaining 
corollaries are similar and therefore are omitted. 

Proof of Corollary \4.2\ 

In the case of Cq cuMS' when senders ^2 and ^3 do not have any message of their own to transmit, they can 
use their noncausal message knowledge to entirely help sender Si. The rate tuple {R{, 0, 0) is therefore achievable, 
where R\ is the capacity of the vector channel 52,^3) — )• TZi, given by 



^J = ^log2 



/ f\/Pi + |ai2|\/P2 + |ai3| VP; 



2^ 



1 + - -I- (3» 



Next, when the rate achieved by sender Si is zero, ^2 can cancel the interference from Si completely by employing 
dirty paper coding. However, di 
regardless of the R^ achievecj^. 



dirty paper coding. However, due to the the message splitting model assumed here, IZ2 sees interference from ^3 

Hence, the rate achievable by (52,7^2) is 



1 / . P9 



Rl= \ogAl+ - ■ (32) 

^ V <32 + |a23| P3J 

When i?i = and R2 = i?2, due to the noncausal knowledge of Si and 52's messages, ^3 can completely mitigate 
the effect of interference and achieve the interference free rate, R%^, given by 

Rl = \^ogJl + ^\. (33) 



2 Q3 

Hence, the rate tuple (0, i?2, ^3) is achievable. Finally, the convex hull of the rate region ©cums these points 
is achievable by standard time-sharing arguments. 

^Except in the case where S-j, helps TZ2 in receiving its message. This case is dealt with in corollary 14.31 
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Proof of Corollary \4.3\ 

As 53 has noncausal knowledge of Si and 52, it can completely mitigate the effect of interference and achieve 



a rate of 



= ^ log. (1 + 1 



(34) 



If 53 achieves a rate less than the interference free rate, then it can use its remaining power to help either Si or 
52- The power required for ^3 to achieve a rate of r (r < R^) is Pf^ = (2^^' — 1)(53- The power that can be used 
to help Si or ^2 is 



p*5i 

^3 — ^3 



When ^2 achieves a rate of zero, then ^2 can completely help Si. Further, ^3 can use the power of P3 ^ to help 
Si. Therefore, Si can achieve a rate 



^log2 



1 + 



Pi + \ai3\\/ Pt + \ai2\VP^ 



(35) 



When i?2 = Ps = then 5*3 can use the power of P3 ^ to transmit the message of 52, and 52 can cancel 
the interference from Si by employing dirty paper coding and achieve a rate 



/ 



^2=2 l°g2 



1 + 



Z^+M^JPt 

Q2 + \a23\^Pt 



\ 



(36) 



Hence the rate tuples 0, r) and (0, R2,r) are achievable. The convex hull of the region ©cuMS ^^^^ these rate 
tuples is also achievable by time-sharing arguments. 



Proof of Corollary \4.4\ 

Due to the knowledge of Si message, 52 can completely cancel the effect of interference from primary but it 
will always see the interference from 53. Hence 52 can achieve a rate 

1 



i?; = - log 1 + 



2""° V" ■ Q2 + \a23?P3 
When 52 achieves certain specific rate of r (r < iJg), the power required is 



P^ 



i2r 



l)(Q2 + |a23|^^'3). 



(37) 



The remaining power P,^ = P2 — P,^ can be used to help 5i's transmission. When i23 = by similar arguments 
as in the previous Corollary, Si can achieve a rate 

/ 

1 



R*, 



■log2 



1 + 



Pl + \ai2\\ PP +\al3\^/P3 



Qi + \ai2\^Pi' 



\ 



(38) 
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(39) 



When Rl = 0, the sender ^3 can mitigate the interference from Si and achieves the interference free rate i.e. 

From (l38T l and (|39] l. the rate tuples (i?J,r, 0) and (0, r, iig) are achievable. The convex hull is achieved using 
time-sharing arguments. 



Proof of Corollary \4.7\ 

In case of Cq ^y-y^^ channel model, the senders ^2 and 53 can only help sender S\ in its transmission. When 
R2 = ^ and R'^ - 0, Si can achieve a rate 

/ {^i + \ai2\VP2 + \aiz\VPz)^\ 



Rl = - log 
^ 2 ^ 



1 + 



v 



Qi 



(40) 



When Rl = 0, both ^2 and ^3 can completely eliminate the effect of interference from Si. However, they will 
experience the interference from each other. Hence, ^2 and ^3 can achieve a rate of i?2 ^i^^ ^3 given by 

> (41) 

(42) 



i?2 = - log 1 + 5 

2 Q2 + |a23|'P3 



From (l40l ) - (|42]) . it is clear that the rate tuples (i?*,0, 0) and (0, iJgj-^s) achievable. By standard time-sharing 
arguments, the convex hull is achievable. 



Proof of Corollary [ 

As 53 has noncausal knowledge of primary message, it can employ dirty paper coding to completely mitigate 
the effect of interference from Si. However it sees interference from ^2 due to the rate splitting. Hence, ^3 can 
achieve a rate 



Rl = I log. ( 1 + 



Q3 + |a32| P2 



(43) 



In order to achieve a rate r (r < iJg), the power required by ^3 is 

P3^^' = (l + (22--l)|a32|'P2). 

The remaining power P3 ^ = P3 — P3 ^ can be used to help Si. When i?2 = and i?3 = r, ^2 and ^3 can use the 
power of P2 and P3 ^ , respectively, to help the primary. The rate achieved by Si is 



R*, 



^log2 



1 + 



VP'i + \ai2\^2 + \an\\IPt 
gi + |ai3|'if^ 



(44) 
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1 2 

where the | ai3 1 -P3 the denominator arises because of sender ^3 transmitting the message to its pairing receiver. 



When Ri = and R3 = r, 7^2 can achieve a rate of 



R* = -log,il + 



Q2 + |a23l^-f3 



P2 



) 



(45) 



From (l44l ) and (|45] |. the rate tuples (i?J,0, r) and (0,i?2;^) achievable. The convex hull can be achieved by 
time-sharing. 
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Sub-message 


Rate 


Description 


mio € {l,...,2"«i°} 


J?io 


Rate achieved: <Si (7^l,7^2,7^3) 


mil € {1,...,2"'«"} 


Jill 


Rate achieved: <Si TZi 


mao € {1,...,2"«2''} 


R20 


Rate achieved: <Sa (7^l,7^2,7^3) 


mai e {l,...,2"«^i} 


R21 


Rate achieved: ^2 ->■ (7^l,7^2) 


maa G {1, 2"«22 } 


R22 


Rate achieved: 5a — >■ 7^2 


mso e {1,...,2"«™} 


Rio 


Rate achieved: 5a — > (7?,i, 7?,2, T^-a) 


max e {l,...,2"«3i} 


R31 


Rate achieved: 5a — (JZi,TZ3) 


maa £ {1, 2"«33} 


R33 


Rate achieved: 5a — > 7?,a 


mi G {l,...,2"-f'i} 


Ri 


Rate achieved: 5i — >■ 7?,i 


ma G {1,...,2"«=} 


R2 


Rate achieved: 52 1^2 



TABLE I 

Achievable rates and their description. For ex., Rh is the rate achieved between 5i and TZi, while R21 is the rate 

ACHIEVED BETWEEN 52, AND 7?.2, TZi, ETC. THE LAST TWO ROWS CORRESPOND TO THE CHANNEL C^pc, WHEREIN THE SENDERS 5i 

AND 52 DO NOT PERFORM RATE-SPLITTING. 



Receiver 


Decoding capability 


7^l 


mio, mil, mao, mao 


7^a 


mio, mao, maa, mao 


7^a 


mio, mao, mao, maa 



TABLE n 

Effect of rate-splitting on the decoding capability of receivers for the channels C^^^, . For ex., receiver TZ2 

CAN decode messages mio, m2o, m22, mao 



Receiver 


Decoding capability 


7^l 


mil, m2i, msi 


7^2 


m2i, m22 


7^3 


msi, maa 



TABLE III 

Effect of rate-splitting on the decoding capability of receivers for the channels Cc,„s, Cp^^. For ex., receiver 72.3 

can decode messages mai, maa 



Receiver 


Can decode 


7^l 


mi, m3i 


7^2 


ma, m3i 


7^3 


m3i, maa 



TABLE IV 

Effect of rate-splitting on the decoding capability of receivers for the channel Cspc ■ For ex. the receiver 

DENOTED TZ2 CAN DECODE MESSAGES m2 AND m3i . NOTE THAT, THERE IS NO RATE-SPLITTING AT THE SENDERS 5i AND 52. 
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Variable 


Description 


Wo € Wo 


Public Information: Si ->■ (7^l,7^2,7^3) 


Wi € m 


Private Information: <Si — >■ Tl.\ 




Public Information: S2 (T^i, 72.2, T^-s) 


Ui e Ui 


Public information: S2 — > {TZijTZz) 


u-z e U2 


Private information: 52 — > 1^2 


Vo e Vo 


Public information: S3 — >■ {TZi.TZ2;TZ:i) 


Vi € Vi 


Public information: ^3 — > {TZ\,TL-i) 


V3 € Vi 


Private information: <S3 — >■ Tls 



TABLE V 

Auxiliary Random variables and their description. For ex., Ui denotes public information from 52 decodable at TZi 

AND TZ2 




Fig. I. Three-user cognitive channel with CuMS 
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Fig. 2. Three-user cognitive channel with PrMS 




Fig. 3. Three-user cognitive channel with CoMS 
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1 .5 




1 .5 



Fig. 4. Two-user interference channels witli different rate-splitting strategies. In (a), neither transmitter performs rate-splitting. In (b), one 
of the transmitters performs rate-splitting. In (c), both the transmitters perform rate-splitting. The power at the transmitters are 7.8dB. 



1.5 




0.5 1 1.5 2 



R.i achievable by Tx^ (bps/Hz) 



Fig. 5. Two-user CR and interference channels, (a) is the Han-Kobayashi rate region, (b) is the rate region of a CR channel where only 
the cognitive transmitter performs rate-splitting IIIOl and (c) is the rate region of a CR channel where both transmitters perform rate-splitting 
l4l . The power at the transmitters are 7.8dB. 



3.5 




Fig. 6. Rate of <Si (Ri) versus the sum rate of <S2 and S3 {R2 + R3) for the channel Cqums- The power at the transmitters is lOdB. 




Fig. 7. Rate of 52 (R2) versus the rate of 53 (R3) when Si is guaranteed to achieve a minimum rate i?i = 0, 1 and 1.5 bps/Hz, for 
channel Ccums- The power at the transmitters is lOdB. 
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Fig. 8. Rate of Si (Ri) versus the rate of 52 (R2) when 53 is guaranteed to achieve a minimum rate i?3 = 0, 1 and 1.5 bps/Hz, for the 
channel Ccums- The power at the transmitters is lOdB. 
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Fig. 9. Rate of Si (Ri) versus the rate of S3 (R3) when S2 is guaranteed to achieve a minimum rate R2 = 0, 0.5 and 0.8 bps/Hz, for the 
channel Cq^ms- The power at the transmitters is lOdB. 




Fig. 11. Rate of S2 (R2) versus the rate of S3 (Rs) when Si is guaranteed to achieve a minimum rate Ri — 0, 1, and 1.5 bps/Hz, for 
channel Cp,Ms- The power at the transmitters is lOdB. 
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Fig. 12. Rate of <Si (-Ri) versus the rate of 52 (R2) when S3 is guaranteed to achieve a minimum rate R3 = 0,0.5 and 0.8 bps/Hz, for 
the channel Cp^Ms- The power at the transmitters is lOdB. 




Fig. 13. Rate of <Si (Ri) versus the rate of 53 (-R3) when 52 is guaranteed to achieve a minimum rate R2 = 0,0.5 and 0.8 bps/Hz, for 
the channel Cp^us- The power at the transmitters is lOdB. 
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Fig. 14. Rate of iSa (Ri) versus the sum rate of Si and 52 (Ri + R2) for the channel Ccoms- The power at the transmitters is lOdB. 
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Fig. 15. Rate of Si (Ri) versus the rate of 52 {R2) when 53 is guaranteed to achieve a minimum rate R^ — 0.5, 1 and 1.5 bps/Hz 
the channel Ccoms- The power at the transmitters is lOdB. 



